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ABSTRACT ' • 

- - - ... A .Symposium was held in May of 1972 to assist in the 

r^so.luti.on of the .varied problems effecting the advance of 
educational tfechnology. Most of the papers presented at the symposium 
dealt with the current situation of various aspects of computer 
.assisted: instructioii (CAI) throughout Canada, Other papjefs covered 
CAI . centralisation^, minicomputers,, cp-oper at iye research projects, 
educational, games,, educational management, .simulations, Jpgic 
instruction, .program, design, language .standards, group use oif CAI, 
teacher-rautbored in.struction, and ."dP.-it-^^urself programing. The 
concluding speaker., noted that a very small .amount of V hard data was 
.presented in the. papers and eoqphasized that the fate^ of CAI will be 
determined by cost-benefit analysis. . (MC) 
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INTRODUCTION 



The Canadian Symposium on 
Instructional Technology was held 
at Calgary University on May 24- 
26 y 1972. The Symposium was 
sponsored by the N;R.C. Associate 
Conunittee on Instructional 
Technology and the University ^of 
Calgary. 

Notes : 

The abstracts of the papers 
are in front of each paper. They 
are in* both official languages. 
The original is at the top of the 
.page and the translation is at the 
bottom. The papers and the titles 
in the index are in the language 
in which they were presented. 

The opinions expressed in the 
papers are those of the speakers 
and not necessarily those of the ^ 
National Research Council or the 
University of Calgary. 

/ 



Le Colloque canadien 
sur la technologie pedagogique 
tenu ^ I'Universite de 
Calgary du 24 au 26 mai 1972, ^ 
a eu lieu sous les auspices 
du Comite associe de 
technologie pedagogique du 
CNRC et I'Univ^rsite de 
Calgary. 

Notes: 

Les resumes des 
communications, dans, les deux 
langues officielles, se 
trouvent en t§te de chaque 
communication. L'orlginal est 
en haut de la page et la 
traduction en bas. Les 
communications et les titres 
bibliographiques sont dohnes 
dans la langue d'origine. 

Les opinions exprimees 
dans les communications sont 
celles des .auteurs et ne sont 
pas necessairement celles du 
Conseil national de recherches 
ou de I'Universite de Calgary. 
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SYMPOSIUM OPENING 

Dr; F.T. Tyler the 
Symposium Chairman introduced 
himself then introduced the three 
'speakers; Dr/ A.W. Carrothers, 
President and Vice Chancellor, - 
University of Calgary, Dr. R.S. 
Rettie, Executive Director 
(External Relations), National 
Research Council, Dr. F.E. 
Whitworth, Chairman of the N*R*C* 
Associate Committee on 
Instructional technology • 

^ Dr* Car r others welcomed the 
delegates on behalf of the 
University of Calgary. He 
recalled that at one time. C.A^I. 
had been advertised as the panacea 
for rising University costs. 
Subsequent experience has shown 
that C.A.I, is- not appropriate 
to all situations and not necessar- 
ily cheaper than alternatives. 
Hopefully, now that unrealistic 
expectatipns^have been dispelled, 
serious research in the area will 
continue to make progress in 
techniques to complement the time 
honoured methods of lecture, 
laboratories and library. He 
hoped this, symposium would 
ccJn tribute to that end. 

Dr. R.S. Rettie welcomed 
the. delegates on behalf of the 
National Research Council. He 
expressed regrets on behalf 
of the president of N.R.C., Dr. 
Schneider, who was tinable to 
attend. Dr. Rettie gave a short 
description of the structure of 
the National Research Council 
and the Associate Committee. 
Dr. Rettie pointed out the need 
for effective communication " 



OUVERTURE DU CQLLGQUE 

Le Dr. F.T. Tyler, 
President du Colloque, s'est 
presente et a ehsuite presehte 
les trois conferenciers: le 
Dr. A.W. Carrothers, President 
et Vice-chancelier de I'Universite 
de Calgary, le Dr. R.S. Rettie, 
Directeur executif (relations 
' exterieures) du Conseil national 
de rechercbes, le Dr. .F.E. 
Whitworth, President du Comite 
associe de technologie 
pedagogique. 

Le Dr. Carrothers a 
accueilli les delegues de la 
part de I'Universite de Calgary • 
II a rappele que, a une certaine 
epoque, on avait annonce que 
I'EAO serai t la panacee pour 
resoudre les problSmes. financiers 
de plus en plus /graves des 
universites. L'experience a 
demon tre, par^la suite, que I'EAO 
ne convient pas dans tous les cas* 
et qu'il n*est pas necessairement 
meilleur marche que d'autres 
methodes. II est 3 souhaiter'^que, 
les^esp^irs peu realistes ayant 
ete dissipes^^^J^ recherches 
serieuses dans ce"^domaine 
continueront a progresser dans 
les techniques qui compleraentent 
les methodes traditionnelles.de 
cours, de travaux en laboratoire 
et de lecture. II avait- I'espoir 
que ce colloque tendrait vers ce 
-but. 

Le Dr. R.S. Rettie a 
accueilli les delegues de la 
part du Conseil national de 
recherches. II a exprime les 
regrets du President du CNRC, le 
Dr. Schneider, qui n'a pas pu 
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between the development engineer 
and the ultimate user, the teacher. 
He a} so stressed the need for 
educators to ask the righ.t 
questions, even to demand the 
right facilities. He pointed 
out that the fourth generation 
computer will probably be 
delayed until the users know 
what they needed and how to make 
the right demands on the 
technologists. He felt that 
the same remarks applied to 
Computer Aided Instruction. Dr. 
Rettie hoped that this Symposium 
would result in a significant 
contribution towards improving 
communication between the. 
educators and tedmoiogists and 
to ensure that the righF^ 
are communicated. 

Dr. F.E. Whitworth spoke 
on behalf of the Associate 
Committee on. Instructional 
Technology. ^Dr. Whitworth's 
paper is contained in the next 
following pages. 



etre present. Le Dr. Rettie ^ 
a decrit brievement la structure 
du Conseil national de recherches 
et le Comite associe. Le Dr. 
Rettie a attire Inattention sur 
le fait qu'il est necessaire que 
1 mgenieur et I'enseignant se 
comprennent bien". H a aussi 
insiste sur le. f ait que.les 
educateurs doivent poser la 
bonne question, et meme exiger 
de bonnes installations. II a 
fait remarquer *que la quatrigme 
generation d'ordinateurs ne sera 
probablement pas develbppee 
avant que les utiiisateurs sachent 
ce dont ils ont besoin et' 
exaqtement ce qu'ils doivent 
dema9.der,.aux technologues. II 
lui .a- semble que la meme chose 
es.t vraie en ce qui conceme 
I'enseignement a I'aide d'ordi-, 
nateurs^^ Le Dr. Rettie a formule 
1 espoxr que les resultats du 
Colloque se solderont par une 
amelioi^tion marquee dans les 
relations entre les enseignant^ 
et les technologues et par une 
assurance que les questions 
pertinentes seront bien posees et 
explicitees. 



Le. Dr. F.B. Whitworth a parle 
de la part du Comite associe de 
technologie pedagogique. On 
trouvera-1' allocution et la 
communication dii Dr. Whitworth 
dans les pages suivantes. 



THE NRC ASSOCIATE COMMITTEE ON INSTRUCTIONAL TECHNOLOGY 
AND THE DYNAMIC EDUCATION MILIEU 

F.E. WHITWORTH 



V 
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THE NRC ASSOC IATE COMMITTER ON INSTRUCTIONAL TECHNOLOGY 
AND TIE DYNAMIC. EDUCATION MILIEU * 

This paper has been t^itten to tell you something about the National 

Research Council Associate Committee on Instructional Technology and the 

difficult problematic situation faced by it and others who wish to'ensure 

that maximum benefit will be obtained from use of the never media. As 

the Committee- is 'composed of individuals with unique backgrounds, the 

ideas expressed herein are those of the author and do not necessarily 

coincide with those of other members of the Committee or of the NRC 

Because of the rapidly changing state of scientific development in 

this area and an unprecedented implementation of social change, any attempt 

to clearly identify or delimit current instructional problems, or to suggest 

solutions which would harness insttuctional technology to dynamic educational 

objectives is obviously doomed to some degree of failure. " Yet we have no 

choice as to whether or not to make- such efforts. To incite us to greater 

endeavour are some encouraging results, some extravagent predictions, and 

some rash, though not impossible, dreams of the computer's capabilities. 

These relate to revolutionary functions of computers in education which 

lie not in business and management applications but in the novel idea of 

computer-assisted learning or. computer-managed instruction. 

The single most powerful- argument put forward in support of CAI, is 

that it will provide for individual differences, making it possible for 

each subject to achieve his full potential. A second or correlative 

advantage refers particularly to current drill and practice programs which 

can be adjusted readily to individual needs. But mostly there are limits 

to the branches, available; and the chief adjustment relates to speed of 

progress through the materials. A third claim relates to immediate feed- . 

back to pupil and teacher. But again, evidence at present suggests that 

claims here may be greatly exaggerated. A fourth relates to release of 

teacher ti«,e from drill activities and the marking of papers. Here again 
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experience suggests that there is little actual saving, and there may be 
cheaper ways .of conducting drill and practice which are equally effective* 

Contrariwise there are arguments suggesting that computerized and 
related, programs will never be adopted. They recognize what we are prone 
to call inertia and apathy oti the part of many educators, parents and 
administrators, and an awareness that progress in instruction has generally 
been slow. The majority of band-wagon panaceas that, have burst on the 
scene like skyrockets have fallen into innocuous desuetude shortly after. 
Institutional rigidity combined with technology in its infancy can hardly 
guarantee rapidity in adoption and usage. Essentially, few schools are 
ready for computer systems and few computer materials now available are 
ready to contribute much to the schools. 

Yet there is a growing awareness that the wants iEacing education 
are not being satisfactorily provided for. Some of these anxieties are , 

\ ■ ' \ ' ( 

clearly identified and focused on jspecified requirements \arfd bbjeccives. i" 
I Others reflect unease and frustration. The pressures for change will 

not be ignored. Educational planning must involve all aspects of society 3 
and resolve conflicting demands. Subh planning must be an ongoing function. 
Instructional technology has an important place in this and an important 

o 

aspect of it is the use of the computer. It is therefore appropriate, 
and vital for educationists, provincial, national and international to 
consider and suggest proper approaches and procedures for its develop* 
ment in the field of education. 

This symposium is but one of the sort of attempts which will have to 
be undertaken if we are to solve some of the problems facing us related 

to effecting advance in instructional technology, \n scope this program 

V 

has been limited to considerations of using the computer in education, which 
appears as a wide spectrum of possibilites ranging ftom housekeeping to 
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engineered instruction. Some of these relate to tho planning and adminis- 
tration of educational services, others to the use cf the corputer which 
provides extensive calculating facilities for educational research; and 
still- others consider the computer's possible use in prcvidir,g resources 
for the educational process. The latter category can include information 
storage and retrieval, the generation of dynamic demonstrations and dis- 
plays, the incorporation of evaluation^ and assessnt-nc devices to provide 
immediate feedback, provision for interaction with the program, and the 
possible incorporation- of all of these in systems or as units in the in- 
struction-learning process. Our concerns at these meetings will relate 
mainly to the computer. as a learning resource, to interactive methods of ' 
instruction, and the providing of assurances ' that attempts to harnesi; the 
computer in instructj^n will be attacked reasonably systematically, co- 
, operatively and on a-grand enough scale to ensure a fair hope cf. Success. 

/ 

The Associate Committee ' / 

The Associate Committee on Instructional Technology is one of a 
number of such committees appointed by the NRC to act as advisory panels 
in selected areas; to provide liaison between appropriate sections of 
the NRC and outside bodies concerned with advance in these areas; to 
advise what research should.be undertaken, by whom and the priority whic.h 
approved projects deserve mthin the constraints of expei-tise and money 
available, and with cognizance of current needs. 

. To committee members, applications of- the computer in the instructions 
learning process though of prime importance is but one of their interests. 
It is recognized that T.V., cassettes, radio and all other rrcdia hardware 
can be utilized in a variety of ways, sometimes as separate resources and 
sometimes incorporated into a system or systems. The system may also in- 
corporate the teacher, book and blackboard either as an intc.,;ral part of 
a closed system, as auxiliary contributors, or as optional resourcos in 



computer-managed instruction. 

The role to be given to the teacher in this is all important^ A 
system could be provided which would operate without a teacher as has been 
attempted through correspondence courses, "teaching machine" programs and 
workbooks, I.P*I. , etc, all of which have lessened or altered her role. 
Again the teacher could be in charge, using the media as aids; or she may 
act as operator of the system in a position to* make alterations or changes 
in materials or program as desired. 

Similarly, determining a suitable role for the pupil is of paramount 
importance. One possibility is to expect the pupil to adapt to the pro- 
grams provided, essentially using equipment devi^sed for other purposes. 
This is generally frowied on, A second is toyproyide a series of units 
which will be completed according to the acumen and motivation of the stu- 

I * i 

dent. Here the student^ teacher or program developer may have chosen 
the units the student^ will wo^'k uhrough and set criteria for successful 
completion of each* * 

Membership Committee 

In the formation of the Committee^ selection was made from among com- 
petent individuals, rather than from representatives of any professional 
bodies, though with consideration for making the committee strong and 
well-rounded and with some measure of geographic representation. Some 
requisites for an invitation were a lively interest in at -l/ast some of 
the branches of .the growing technology, a vjillingness to devote time 
and energy to further the development of such technology for the good of 
education, and the wish to weigh seriously possible strategies aimed at 
"'the timely and expeditious implementation of the newer media in the in- 
structional fields. As a result, the Committee members represent com- 
petencies in such fields or areas, as: psychology and . sociology; general, 
adult and university education;, the systems approach; engineering; com- 
munications; research design; 'dove Ijj^ment strategies; and business ex- 



pertise from some technologically-oriented industries. Membership is 
normally for three years, one^third being appoint;ed each year. Members 
serve without salary. They may be reappointed. 

Operations of the Committee 

The Committee has met three times a year during the-first two years 
to get it firmly established, but meetings may b^ reduced to two in number ^ 
annffally henceforth. -To help those interested from outside keep in touch 
the conimUtee^issues a newsletter at irregular intervals, which is avail- 
on request. Short contributions for publication in the newsletter 
are welcomed. 

This Committee was thus conceived as a coordinating body in the field 
of instructional technology acting as an advisory body national in scope. 
To carry out its responsibilit " es it has attempted to make some advance 
in certain areas through organizing sub- commit tees which report back to 
the full committee. i 

At ics inaugural meeting the Committee agreed -on the following objec- 
tives: 1) To bring together specialists from the various disciplines 
involved in the field of instructional technology, in order 
to formulate requirements and establish guidelines for re- 
search and development; 

2) To promote interchange of information among workers in diff- 
erent disciplines, as for example, through the organization 
of symposia; 

3) To promote and coordinate relevant research and development 
in universities, government laboratories, and industry, with 
the aim of establishing a strong, Canadian-based capability 
in this field; 

.4) T6 encourage a degree of standardization iri instructional systems 

sufficient to permit all provinces to benefit from the inter- 
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change of instructional material. 
Sub-Commit tees 

It has been noted that the Committee aims to bring together sptcial- 
ists from various disciplines combining the theoretical and practical in 
formulating guidelines for appropriate research and developwtntal endea- 
vour. Its sub-committees are appointed from among ic»n!«»mbers nnd experts 
outside the Committee to undertake specific tasks. These sub -commit tees 
complement other efforts of the Committee which seeks to accomplish the 
setting out and pin-pointing of endeavour through calling "Seminars cr 
workshops designed to provide for a meeting of minds and exchange of 
^ ideas. Such meetings can int^roduce international, national and local 
content and help to ensure advance which is most likely when undertaken 
.at not one but all levels. 

One of the sub-committees constituted to date has been charged with 
developing specifications for Computer Terminals for Instructional Appli- 
cations. It was considered that there was an urgency here anci chat there--> 
fore this task should receive high priority. Adoption of minimum speci- 
fications could be beneficial to buyers, educators and manufacturers. 
Detailed engineering and functional as well as systens performance speci- 
fications need to be set out. Standard features and- options need to be 
listed with consideration for noise level, appearance, feel, portability, 
reliability^ display rate, line length and other pertinent specifications, 
A second •sub-com:nittee was appointed to deal with the sharing of in- 
structional technology materials. It was recognized that there is need 
to provide for, the- easy and efficient distribution of materials if we 
are to keep costs down, eliminate needless duplication of efforts and 
produce a quantity of quality programs in a reasonable time. There are 
difficult problems of costs and copyright but answers to these must be 

found. In addition, in Canada materials must be available in tlie two 
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languages^ English and French* 

IT.e difficulty of providing networks for the distribution of program 
materials is impressive. The communication tools may include satellites 
cables, wire and wireless, cassettes, films, records, etc. How these 
are to be used may depend on whether representation is one, two or three, 
dimensional, whether communication is on line in the interactive mode 
between teacher and pupil, which peripherals of the computer will be 
used, and the percentage' of the process to be taken over by computerized 
^education. 

The problems mentioned, and there are many more, are of concern to 
. other bodies than the Committee, such as the Canadian Standards Association 
the Department of Industry, manufacturers. Departments of Education, and 
in fact, anyone interested in marketing or using related materials. 

A mail survey of the field led the Committee to the conclusion that 
there is a woeful lack of reliable information on currently available 

0 

materials. This problem is by no means unique. Years ago a similar one 
was faced in the area of tests and measurements and resulted in the pre- 
paration in the U.S.A. of a yearbook covering specifications on the tulk - 
of standardized tests. In addition it appears that much material has 
only limited local application. Some of it has been lifted bodily despite 
copyright restrictions, and some is restricted in distribution because 
of local regulations. Much of it would not be generally acceptable sii'ce 
most people today expect a high commercial quality of the materials on 
sale. 

A third sub-committee is a working panel concerned with computer 
languages. The advantages of having a standard language with wide usage 
and provision for modification as needed, and one having accented French 
characters seems patently clear for Canada. Only manufacturers interested 
in cornering the market, or a large\art of it, or lone wolf researchers, 

-20- \ . 



might disa^re.e. This suh-coiranittee has recognized that materials are 
currently appearing in many languages and suggests that efforts to achieve 
agreement on one language ^hould be given^^high priority. 

The Committee's Commitment to Reseatf^^ " 



The Committee is dutybound to^ttempt the following: to identify 
specific areas concerning^^^jse of automated instruction which require re- 
search and development; assess the research activities needed and already 
cotnpleted; advisef on the facilities and manpower required to complete 
the others; provide an festiwate 6i costs for each; make ^recommendat ions 
as to where each could be carried out b.est and by what body e.g. industry,*? 

4 

university, ^government, Other facility, etc; and establish a set of priori* 
ties to covqr the projects. One sub-committee is concerned with research 
needed and priorities. 

Before we can consider the implementation of computer applications 
and make use of the heater media to the extent that automation has affected 
other industries, educators must first identify the purposes of education 
•and establish uititivate, intermediate and behavioral goals. This need not 
go so far as to provide one or several systems, or the adoption of a 
behavioristic approach. Education will always be an art and its product 
unique pieces, but thex^e is a place for ^science in it. The role of the 
teacher will change, but only for him to become more professiciial. 

Within the constraints of money, professional competence and communi- 
cation expertise, such identified problems should be attacked anr} solutions 
sought through research. This suggests a need for better planning in our 
research and development undertakings. We recognize that progress has 
and will continue to result from sporadic efforts of individuals in 
scattered laboratories working on an inspirational and creative basis. , 
The bulk of research today, however, is conducted on a concerted systematic 

base. 'Af'. much'of this rese,arch is costly, interdisciplinary, long-term, 
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and demanding s^^t^^^^e, sought from only k sources, and normally 
• only when there iU_assurance that a «^11 corxceiWd plau will be executed 
expeditiously, ef f iciefitay and with some'^We for success. 

. Research should be- directed to the testing ind evaluation of soft- 
■ ware and hardware and this tesearch.-shogld be conducted at all levels 
from local to iuternational/ • Just as research should be undertaken at • 
all levels so is there- need for the establishment of standards which are 
generallyapproved.- This is necessary to effect maximum transferability 
; Of hardware and software systems and" materials. International cooperation 
-can help to ensure coherent national^ll^ograms and international communi- 
cation .lines, providing for joint. p^v in cial, national and internarfsnal ' 
project Si . 

,■ One concern throughout relates to compatibility, or the ability of 

separate systems elements to be interconnected and «,rW togetherr^ether 
we are considering hardware con.ponents, software, or the media or char- 
ac^e^codes.' Limiting factors may.be the speed of operation e.g. a type- 
writer^eyboard; electrical, e. g. the voltage of signals; load, etc.; logi- 
cal, such, as code compatibility and control logic, and control signals, 
etc. There are conversion devices which will link incompatible materials " 
in some instances but one should. be sure that the linkage is satisfactory. 
At best it is a poor substitute for providing compatible component parts 
in the first place* * 

The current Situation , , ^ 

It follows from what has-been said that the Committee, as with others 
working in the field, cannot work vithouf full cognizance of the current ~ 
educational context. Today . ^.e 'have many enigmatic situations in society. 
In education many persons continue to favour established traditional methods 
which use labour intensive procedures. They resist technological innovation, 

as dehumanizing, depersonalizing and destructive oi tencher-pupil rcpport 
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and the professional autonomy of teachers. Some educators have accused 
industry of having sold them down the river with teaching machines and 
programmed instruction, language laboratories, televisioi^ and more re- 
cently, contracts At the same tiine there is criticism* of 
education's inadequacies as being stodgy, old-fashioned, rutted, indecisive 
providing^^a stereotyped prcgram that has little relevance to modern needs, 
and in fact is damaging to creativity and growth for many. Researchers 
provide little help because of conflicting evidence as to the relative 
value of book,^ human voice, the jtalking face, films, television, radio, etc 
Education today is no place for timid souls/ 

Instructional technology emerged in 1950 hopefully to provide indi- 
vidualized irrtruction and an enriched program. Te.acher acceptance has 
been varied and it appears that teachers most readily accept those mater- 
ials that are simple in operation, reliable, and least affect thoir tradi- 
tional role. There is need for an early beginning in exposing teacher 
trainees and teachers to the newer media so that they will feel at home 
with- them and appreciate their possibilities. 

An evaluation of the present state of development in instructional"^^ 
technology, and efforts to make this known to teachers, parents, school 
boards, 'and the general public is essen*.ial if we are neither to oversell 
nor Undersell the true situation and hurt the chances of eventual large 
scale adoption. Implementing new approaches is always difficult and 
often unsuccessful. There is rid assurance that aU promising proposals 
for innovation will be given a fair trial or that we shall benefit from 
them as much as we should. One thing that complicates the situation and 
increases the obstacles in the way of modernizing education through the 
use of the newer media is the lack of agreement on method of attack and 
the goals to be achieved. The whole problem must be attacked from many 
sides if success is to be achieved. 



Current literature, among other things, suggests that, education today 
must meet the needs of all persons from infancy to old age. it suggests 
that it must be relevant. Some would have it pupil-centred to a degree 
where each student would select' his own course, units of work and study 
approaches. Others would provide stereotyped courses and still others 
favour the traditional approach covering a variety of procedures. Some 
are sure that the use of the newer media goes hand in hand with a narrow 
behavioristic approach and that both teacher and pupil will be relegated 
to the position of objects in an on-going process concerned with input 
and ^output only. There is also some confusion as to whether ornot we are 
talking in terms of one, or a few large systems, or of a number of unrelated 
small systems, rather than both large and small computer utilization * 
with access among them and with provision ^or incorporating the older 
as well as the newer media IntcL the education process. Tnere is some 
concern as to whether the computer will.^take over education or whether 
«e are talking in terms of media as education aids. .The relationships 
"between learning theory, curriculum construction, and' the preparation 
of units remains unclear. 

The choice- of materials at present 'is extensive and varied with 
equipment being portable or fixed and programs piped in from central 
stations, or initiated on the spot, etc. However the software available 
is. decidedly limited in quantity and much work is needed here. 

?o date systems have either been explored as demonstration or 
development devices with primary emphasis on determining feasibility . ^ 
of greater development of the technology. Some work has been donCoC^ 
the development of educational content, its distribu^loif^r^^^ 
with little research on the ba'sic teaching- leafni^^^cess made possible 
by interactive computer-based instructional systems. The gap between 
the preparationyf materials and their distribution, and the incorporation 
of these into current instructioh_al^procedurcs must be subjected to re- 



search which shows promise of resulting in the modi cici?f ion cf both the 
materials and programs prepared, and of the conventional n^euhcds of in- 
struction. 

It appears imperative that the education community take the initiative 
in accepting responsibility for defining goals and uses o£ computer tech- 
nology in education. The functions performed by tlic ca4a;;ytcr ana t]:e 
materials to be developed for use in instruction should be the ur*ique 
responsibility of. education. 

At the same time there is need for intercommunications among industry. 



education and government 



personnel with each involved and contributing 



according to his responsibilities and makin^^ossible contributions in 
hardware, software, distribution systems, pilot projects and evaluation. 
Such intercommunication cannot help but be mutually beneficial. Without 
it, and without planning, no one can predict the future course of in- 
struction in Canada. At least this is how one member of the Conanittee 
sees the /current situation, as one in which the challenge is to have 
specialists in various disciplines related to instructional technology^ 
formulate requirements and guidelines, promote interchange of information, 
foster and provide for the coordination of research and seek to achieve 
the degrees of standardization that appear necessary. 



KEYNOTE ADDRESS 
by 

o 

Geoffrey Hubbard 
Director 

United Kingdom National Counc-ll "for Educational Technology 



•.26- 



by 



Geoffrey Hxibbard 
Director 

United Kingdom National Council for Educational Technology 



l^y I first address iryself to the question, "What is educational 
technology?" Strangely enough, we haven't got that one sorted out 
yet? quite often I hear people .expressing regrets that the term 
was ever introduced, and wishing we could find another, better 
description. But nobody ever comes up with one, and without 
wishing to sound like an old China Hand, I do remember, a mere five 
or six years ago, what a relief it was to stop heading one's 
memoranda "Hie use^of language laboratories, audio visual techniques, 
closed circuit television, programmed learning and so on in education" 
and to settle for the comprehensive phrase, "educational technology". 
If in the intervening years we haven't made it clear what the phrase 
means, and if it hasn't acquired a good lustre, it's not the fault 
of the words. 

As cux example of the range of meaning the term is held to cover ^ 
perhaps I can re^ a short passage from Chapter 2 of the recant 
report, "Central Arrangements for promoting Educational Technology 
in the United Kingdom",. ^ 

"8. Educational technology comprehends a nxuiiber of 
distinguishable areas of activity. The most familiar 
is the use of technical devices to support the processes 
of teaching and learning. These/ include visual projection 
apparatus, radio and television systems, tape recorders 
for sound and vision, duplicating, photographing and other 
reprographic equipment, language laboratories and teaching 
machines, from the very simple to the highly elaborate, 
some of which require staff with special training or 
experience to operate and maintain them. 

9. However, the use of technical aids is not self 
sufficient. They are devices for conveying learning 
material which has to be supplied either by the individual 
teacher or by some other teacher or author on his behalf. 
Other aspects of educational technology relate therefore 



/to the 
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to the production of this material. Sometimes it stems 
• from the general interaction of tether and student wiS^ a 
range of problems and situations. At other times it 
in the material more system;tically 

m the light Of research into the processes of learnina 
particularly of learning by a carefully designed seq^enie 
Of steps. This process is characteristic ofwhat has 
become known as programmed learning, although even here 
current practices frequently embrace course structures 

?hus"thrt'^ '^^^ originaurconc^ived! 

Thus the teacher constantly requires facilities to make 
resource material.for himself, or to adapt to his o^ 

---- Siise^^eeds" 
^iin ? *° P^^l^aps in response to 

changing local circumstances or to the evolution of new 
attitudes and approaches to learning. 

^ Moreover, in responding to his day-to-day problems 
technr ^° integrate new ^stems'^aS 

has^n?r i ""t" ^^^^ ^^^^ innovation - 

has implications beyond the confines of his own classroom- 
■ xt may impinge on the work of his colleaguks Tr create 

: °^ ^^^°"«"°<3ation and fIrSncial resources 

cannrLnsIbr\""^'"'"'r-^P-^- °f educational -tech^o"^ 
ora^n? ^^nsibly.be dissociated from consideration of 
organisation and management, or curriculum content 
innovation and development." ^omient, 

and, a little later in the same chapter: 

^i^T^ ^ -••-.We find general agreement that it comprehends 
both technical. aids and resource material. its claim to 

InTliltr^'T^ -^-i-tion, buildLg d"i^ 

and similar subjects has had, until now, less scrutiny 
and consequently less support. ..." scrutiny 

^o^her^it'f srb^oaTit'lLS' ^^-"'^ ^"^^^ ^-^-^ on the 

quality o^ ^ducSon ^o cLril^^-^L"^'!?'"" 

w:iind\^re^-cS^^^^^^^^^^ 



cannot teach anybody anything; you can only help him to learn, 
and the ^elated idea that, by defining v*iat -we want to have learned, 
putting a great deal of thought into the creation of a lea^rning 
system, measuring how well it works and' revising it in the light 
of that evidence, we can move towards more effective learning. 

However, there is one trifling disadvantage about this idea - 
that the process involves a great deal of effort, a great deal more 
time and effort than ,ds required for more orthodox lecturing or 
teaching. It- is here that the two streams^ converge, for the way 
to get an adequate return from the greater investment in developing 
an effective -systematic learning system is by applying it widely. 
Just as the effort involved in turning back-pf-envelope lecture 
notes into a properly organised book was rendered worthwhile by 
Mr Gutenburg and his moveable types, so the further effort of 
developing learning systems ifsing print and non-p^int materials is 
justified by our ability to replicate them and,' by the use of 
modern communications systems, to make them widely available. 

Thus it seems to me that educational technology is essentially , 
a matter of concepts and ideas, but those concepts and ideas are 
only practicable if we use to the full the capacity to replicate 
and disseminate which the second phase of the industrial revolution, 
the communications revolution, has put at our dispc^al. 

And how far has this interpretation of educatijonal technology 
spread in the UK? Well, first of all the UK is a country where 
the concept of educational autonomy and decentralisation is either • 
a religious principle or a disease^ so that we have a great 
diversity of experiment, mostly on a rather small scale. /We can 
show examples of almost everything - you name it, we've got it; 
though I' wouldn't be sure of ^putting my hands on it in a htirry. 
Indeed, ^bne of the problems in Britain is knowing just wha/t is 
going on in its 35,000 schools controlled by about:' 260 Ic^al 
authorities. 

Because we need this kind of information we recently asked 
the BBC Education Correspondent, acting as our part-time consultant, 
to gather together details of some of the more important innovations 
at school level that one doesn't normally hear about. The 
interesting thing is that he has been overwhelmed with reports. It*f 
too early to generalise his finding:^ but it's already obvious that 
many more schools than v/e supposed are moving from technology in 
education to the technology of education. In some areas the 
developments are quite considerable. \ We are now going to select 
3ome of the more significant cases and document them on audio-tape, 
slides and films, because our experience is that teachers and 
administrators are much more likely to be encouraged to innovate 
by honest illustrations of what is already-^happening than by any 
amount of theorising and sermonising. (This is a fact we ignore 
at our peril I) 

/At the • . . ^1 



At the same time, if we are only just discovering the ferment 
t-T K^'^ti^ innovation, we also have some major developments 
which make the British scene particularly interesting -'the Opin 
university, a very significant large scale development in prov^din 
learning systems for adult students; considerable investment in 
closed circuit television applied to all levels of education 

c?ties"'a"id:'' '''"'^^^ '^''^ ^^^-^ two -all 

tll^ tLy. provision of educational programmes of 

In7t^et-r public" service broadcasting networks; 

IrLl^ r ^^""^^ °^ curriculum studies being undertaken by the 
schools Cpuncil for J;he Curriculum and Examinations, many of which 

^ n^n^Vook'L^r^^^^'^" - --^^^^^ -ook 

m.n^ ^ P^^^^^^l^^li^ interesting feature has been the rapid develop- 
ment of interest m "resource based" learning, partially perhlps 

? ^^^'^"^ ^''^ ^'^'^ behaviourists and exponents oJ 

the tightly structured system. There is a tendency to equate 
structuring with certain subject areas =- to assume that maths 
and science are sequential and can therefore be structured but 
that social science and arts subjects are not 'sequential and 
therefore accord better with a resource based approach Mv own 

which are sequential. it may well be that structuring can be 
applied to parts of any subject, but to the whole of none i 
believe in fact that we apply much effort and energy to decidina 

deter^inL b '""T'^ ^^^^'^ ^ relatively'^sJmp^r choice, 
l! ! .^L ?^ algorithm that. gives the cheapest effective medlim 

acc^^^nTTT^ educational specification) while taking little 
account of the factors wh'ch lead to the choice of mode of Laming 
part^r ^"""'^ concerned with our educational aims'nd^ 

partly with our- personal and te?nperamental inclinations. In the 
present state of knowledge, when so much educational re;earch turns 
probabivTTf —Its, our learning theories are 

p'^rs^nal pr^dSecll^ni" '''''''-^ ^ ^^^'^ - 

M ^""^ ^^^°^^try like Britain, a national agency such as the 
National Council for Educational Technology canno't expect to pursue 
direi.'^ Of centralised innovation; our activities have to be 
directed rather to facilitating the developments which potential 
innovators m the educational system are themselves anxfouJto 
implement We look for the barriers to innovation, ,tL road 

W ^ha^el^uLhed^' ^° t\-. " 

we have launched some projects which produce materials or learning 

systems: the Continuing Mathematics Project, developing sei?- 
instructional materials for non-specialist sixth-formers- the 
primary Extension Programme concerned with audio visua^media and 
as^ist'lrr^^^' development" Of materials to 

eTaTle ^""'"'"^ educational technology, for 

example But much of our concern is with areas of activity which 
do not involve development of materials: with identifying 
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spontaneous innovations, from which we can draw case studies to 
guide and inform others;- with creating a system to facilitate 
the application of educational technology in pre-service training 
of teachers; with the development of information systems, biblio- 
graphic techniques for non-book materials and consultancy services; 
and with the cracking of such specific obstacles as copyright and 
copying services, timetabling and scheduling, specification and 
standardisation. 

Now-despite this general strategic approach, in a far-sighted 
action some five years back, the Council einbarked on a study which 
was described as an Advanced Project in ^Educational Technology, 
the idea being as general as that, that in^among all the practical 
short=-term objectives, there ought to be something that set the 
sights a little higher. ^APET made its goncern the potential of 
the computer in education. A study team surveyed the United States 
and the United Kingdom scenes, with a. general look at the rest of 
the world; a conference was held; a niunber of reports were 
published and in 1969 a little pamphlet called "Computer Based 
Learning: a programme for action" was put to our Gpvernment. 
It suggested that roughly '$-5.2M should be spent, over about five 
years, on supporting a co-ordinated programme to develop Computer 
Applications in Education, based' on four or fivecertres where w9rk 
was already in hand, even if on a limited scale. 

I had no thought, when I accepted your kind invitation, that 
I would have anything further to say on that subject. In fact, 
just before I left the United Kingdom an announcement was made that 
just such a programme is to be launched, and the National Council 
will be closely ooncerned with the management of it. It will not 
be the programme we were thinking of in 1969, naturally, and I 
thought it might interest you if I shared my thoughts with you 
about the way in which our programme might develop. I say might, 
because being Director of the National Council is very like being 
the father of a child. You are in at the conception, in at the 
birth, you. get a fair share- of all the slog of bringing it up, but 
when it gets to the stage of being a fully autonomous individual, 
your duty is to stand back, let go, and watch it make -its own 
mistakes. So just at this stage I can say how I shalx try to help 
the programme to develop, what I think the priorities should be. 
But what actually happens is probably another story. 

You probably read the 1969 reports.^ The main emrjhasis was 
on the computer in a direct teaching, tutorial role and' in a back- 
up management role, in fairly highly structured subjects like maths, 
science, medicine, or technician training, and there was particular 
provision for the development of student terminals, seen as providing 
facilities for visual presentation and something other than typed 
inputs. One point made there still seems sound to us; that 
initially CAI in any forjn is going to be most appropriate to the 
upper secondary and tertiary sectors. I don't think it matters 



very much whether our costings are accurate; it is ^^impiy that 
the first applications are^going to be expensive;' like every new 
application the costs will go down with time and breadth of applic- 
ation. Now the unit costs of education rise with the age of the 
stuQent because ^traditionally the pupil/teacher ratio decreases 
with student age. So the break -even point for the computer comes 
sooner at the upper end. 

But some of the approaches to computers in education which hav 
been suggested and tentatively explored do seem open to question 
For example, the idea of mapping the structure of knowledge 
reading It into the computer and programming a chatty informal 
tutorial exploration, seems both over- optimistic and educationally 
naive. For one thing, does knowledge have a structure? Surely 
not m any unique sense; there are almost an infinity of str.^cture 
of knowledge, depending on what you want to use it for, how much 
^r;; f ^^^^ with, what sort of attitudes you have. And the 

other half of the process, dressing up the computer to behave like 
an Oxbridge don, seems to me to be as misguided as putting false 
eye-lashes on the lens of a television camera. 

to mon?<^ y^ -^i^^ll not get the best out of the computer by attemptin 
and huiL T ''''^ tutorial is a peculferly human 

and humane mode of instruction; perhaps it's best left to human 
beings. instead i think we should look at the totality of the 
educational process and at the characteristics -of the computer 
and see where the two match. ' There should be a\lose consonance 
between our programme for promoting and encouragii^g. educational 
technology and our programme for the computer as an \ducationa I 



For one thing, we are already using computers in certain roles. 
They are an essential element in any comprehensive information 
■Zl^l^' the only practical tool that enables you to undertake 
•multi-co-ordinate search and retrieval of a large data base. They 
offer a prospect of fast, efficient scheduling - and scheduling 
leads to resource allocation, and resource allocation to computer 
managed instruction, where we already have some experience. Then 
again, the computer as a data processing device is almost essential 
oarticuT'^^v''''^ application of progressive test and assessment, 
particularly as a diagnostic device cr a means of determining 
learner profiles. And the same type of diagnostic procedure 
coupled with the resources of an information system, can be applied 

tVltn.T ^''"''^'■^ ^"^^ -^^^^y^^^ Of educational problems and 

the proffering of possible contributions to their solution. 

rr f^"^^^^' the computational power of the computer can be used 
n^?!^H examples, -particularly multi-variant examples, as well 

a straightforward support service, allowing ihe student 
to attack problems which would otherwise be insoluble simply by 
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doing calculations for him. Beyond this, the most difficult and 
challenging application is to genuine problem solving. 

My own vision of the future, if our programme is in any sense 
successful, is thus a long way 'from the picture of earnest students, 
each in his carrell, signing on to, the computer which, after a 
warm greeting and a friendly enquiry as to their personal well- 
being, moves into a Socrato-electronic dialogue. Rather I would 
see the computer in the classroom as the student and the teacher's 
Man Friday, versatile, . patient , untiring, infinitely exploitable; 
being used at one moment to search out information, at another to 
keep or analyse records, then to calculate, then to generate a 
sequence of examples. And let us not forget that, ly the time.^ 
we get anywhere near this stage in education, there will be many 
many things we shall be able to do given only we have a terminal 
and a telephone line. After all, the one job we could do tomorrpw 
or rather yesterday - £s using the computer to book for the fifth 
form to go to see Macbeth. 

I hope that the close association of the National Council with 
the British Computer Assisted Learning Programme will ensure that 
the Programme develops with our general educational technology 
activity in the closest possible interaction. The aims after all 
are the same - to apply new concepts and techniques to the purposes 
of education so as to improve the efficiency and effectiveness of 
the process and the pleasure and enthusiasm of students and teachers 
For education is about people, and we, as educational technologists 
in general or Computer Based Learning experts in particular, share 
in the responsibility for ensuring that people come first. 
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DESCRIPTION PES ACTIVIT^S CAI AU SESSION lA 

„ , MINISTERE DE L'a)UCATION DU OUlfBic ROOM/SALLE 1A8 

^ By/Par: William Lee ' 

Directeur adjoint \ 
Service de 1' Informatique 
o« ' Le Uboratoire de Peda^ogie Informatique du MinistSre de l»/ducation 
en operation depuis le debut 1970, groupe actuellement 20<^persounes (11 

L S^laSons d'e'SeT''''"'^ ''^'^'^ ^^'^'^^ electronique IBM 1500 dote 

Les object if s du Laboratoire sont: - , 

- De former un premier groupe dfe specialistes en enseignement ^ ^ 
assiste par ordinateur,. 

- De developper des cours experimentau:, et les evaluer 

- De f aire des recominandations concernant 1' applicabiUte du CAI dans 
ie sens d un developpement rationnel au Queb-c^ 

»A^h^ln.^. ^^"^^^"^^ ^te developpes au Laboratoire en informatique 



Une experimentation pedagogique \a I'aide -lu systSme conversationnel ttf 

LrsLTr^tius'^tj^n'dT '"tf"" ""1^^ Nous'^rvrsr" 5n?o":Ji;:'de 

coinmencer i utilisation du systSme coursewrl^ter III vers septembre -1972. * 

' DESCRIPTION OF THE ACTIVITIES IN CAT AT THE 
DEPARTMENT OF EDUCATION-OF QUEBECT 

The aims of the Laboratory are* 

" instru'^tiof '''' °' specialists in co.puter-asksted 

. -To develop experimental courses and evaluate them 
" Str:n1l'^d%^rS:;j°S ZilT' .^"P^^"''^^^'^ °^ CAI for 

Mathen«tics!'Se"^r:nL"'%Je\':h'cr:l'ra:r? ''-a-processing Laboratory: 

PL/1 and COBOL a?e useS ^/nart nf / ? Geography. Programming courses such as 

An analytical method S coaLe cons JuJ^ion as'ln^ Data-Processing, Service. 

^Have been developed in the Cbo^aJSry ' °' supporting functions 

in several Ve^lTl?ill7c-TTt\T'':^ conversational system is under way 

In about SopSber ;972t '° Coursewriter III system 
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PROGRAMMES DE SUPPORT POUR LE CAI DEVELOPp/s AU SESSION IB 

LABORATOIRE DE Pfl)AGOGI£ INFOR>fATIOUE ROOM/SALLE 148 

By/Par: Luce Paquin Roberge, 
Analysts » 

Service de I'Infonnatique 

A partir des possibilitcs du syst^me IBM 1500 et du langage coursewriter 
11 f le Laboratoire de Pedagogie Informatique s*etait fixe des objectifs quant Si la 
souplesse des cours qui seraient produits. On a voulu entre autres: 

- Donner une certaine liber te ^ I'etudiant en ce qui regarde la formulation 
de ses reponses; ceci inplique une analyse des reponses plus sophistiquee 
que celle offerte par CWII; 

- Permettre ^ l*etudiant dc poser des questions auxquelles on fournirait 
une reponse adequate le plus souvent possible; 

- Qu'une notion » une fois prograxnmee, puisse etre utilisee dans plusieurs 
cours » s'il y a lieu; 

- Avoir la possibility, pendant le derouleaent d*une le^on, d*eliisiner 
certaines parties du cours ou d*en ajouter si necessaire ^ la bonne 
comprehension de la suite; 

-Enrichir le CWII dans le sens des besoins exprimes par les professeurs 

du laboratoire. 
Ces objectifs nous ont amenes ^ parler: 

- de nodules » 

- d*enchatnement de modules > 

- de modification dans la presentation des modules > 

- d* analyse de reponses, 

- d*analyseur des questions d'etudiants. 

Pour ce» il a fallu etablir des regies d'utilisation du CWII, ecrire des 
fonctionit et op€rer certaines modifications au "software" du syst^me 1500. 

A l*aide de Inexperience acquise sur le ^syst^me 1500, nous avons connnence 
le developpement d*un eAsemble de f one t ions susceptibles d'augmenter considerablement 
les possibilites de CWIII. 

SUPPORT PROGRAMS FOR CAI DEVELOPED IN THE 
LABORATOIRE DE Pfl)AGOGIE INFORMATIQUE 

Taking ixitoaccount the possibilities of the IBM 1500 system and the - 
Coursewriter II languag^^t^e Laboratoire de Pedagogie Informatique s^t^ out its • 
objectives concerning the flexibility of the courses which would be produced. It was 
desirable among other things: 

- To give a certain freedom to the student concerning the formation of 
his answers; this implies a more sophisticated analysis of the answers 
than that offered by CWII; 

- To allow the student to ask questions to which an adequate answer would be 
given as often as possible; 

- That an idea, having been programmed once, might be used in several 
courses as required; 

- To have the possibility, during the lesson, of eliminating certain parts 
of the course or of adding to it, if this is necessary for a clear 
understanding of what follows; 

- To enrich CWII according to the needs felt by those teaching in the 
laboratory. 

These aims have led us to speak of: 

- modules, 

- linking of modules, 

-.modifications in the presentation of modules, 

- response analysis, 

-* students' question analysis 

For this, it has been necessary to set up rules for the use of CWII, define 
functions and carry out certain modifications of the software of the 1500 system. 

With the help of experience acquired on the 1500 system, we have started 
to develop a set of functions which could lead tp a considerable increase in the 
possibilities of CWIII. 
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MAKING C,A,I, HAKE A DIFFERENCE IN COLLEGE TEACHING SESSION 10 
By/Par: .Stephen K. Lower SALLE/ROOM 1A8 

de I'Universite Simon Fraser 
Simon Fraser University 

This presentation attempts to discuss some of the factors 
that enable a computer-based instructional system to function as part 
of a practical and effective learning system, operating within the 
academic mainstream of a university environment. It is the author •s 
view that all too many university c.a.i. installations are so far 
removed from this context that c.a.i. as an instructional tool is 
already in some danger of following the "programined instruction" of 
an earlier era down the ''dusty road to well-deserved oblivion. 

A brief summary of c.a.i. activities at Simon Fraser 
University will be given, with particular mention of the organization 
of c.a.i. services, the use of our courseware by other institutions, 
and our attempts to interface audio-visual devices such as slides, 
audiotapes, and the Philips •'P.I.P/* unit to a conventional c.a.i. 
terminal system. 

Finally, we will comment on our experience with the 
Coursewriter III system, and on the steps that must be taken if this 
system is to become a versatile and adequate instructional tool. 

COMMENT AffiLI9RER L'ENSEIGNEMEin: UNIVERSITAIRE 
A L*AIDE D*ORDINATEURS 

Nous essaypns d'examiner un nombre de facteurs permettant a 
un systeme pedagogique, base sur un ordinateur, de const ituer un systeme 
d* instruction pratique et efficace dans le milieu de l*enseignement 
universitaire. L'auteur est de I'avis que beaucoup trop d* installations 
universitaircs sont tellement loin de ce contexte que I'ordinateur, comma 
moyen pedagogique d' instruction, risque deja de suivre le meme chenin 
que "I'enseignement programme" d' autrefois et de sombrer dans un oubli 
bien merite. 

Nous donnerons un bref restime des travaux en CAI ^ l*Universite 
Simon Fraser avec mention speciale de 1* organisation des services du CAI, 
1 utilisation de nos syst^mes de cours par d*autres etablissements et nos 
tentatives pour brancher des dispositifs audio-visuels tels que Ics diapositlves 
les bandes sonores et le systfeme "P.I.P." de Philips, sur les terminaux 
d'un systeme EAO. * y 

Enfin, nous ferons part de 1* experience que nous avons acquise 
avec le systeme Coursewriter III et de ce qu*il faut faire pour que ce 
syst^e devienne un outil d'enseignement satisfaisant et de grande 
souplesse. 
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MAKING C.A.I. MAKE A DIFFERENCE IN COLLEGE TEACHING' 



The potential benefits that direct on-line inter- 
active c.a.i. can bring to the learning process have been 
pointed out by numerouG authors; that few of these bene- 
fits have yet been realized in practice at most institutions 
in which c.a.i, is available is probably equally well 
knovm, although perhaps less commonly discussed.* 

Since expense is an important consideration only 
when it is great, I will restrict my discussion to c.a.i. 
systems whose level of sophistication requires the cap- 
abilities and facilities associated with a so-called 

large" computer. Generally, this means a convenient and 
flexible interactive authoring language, input-output 
control programs to accommodate "a number (sometimes a large 
number) of student terminals, storage facilities for an 
adequate amount of course material, and above all, a pov/eir ' 
ful and flexible student response processor. This is not 
to imply that ^ "small" computers (PDP-8 through the Hewlett- 
Packard class, / say) do not have their place as learning tools- 
they certainly do, and new instjjuctionaL uses are constantly' 
appearing. Generally, hov;ever, computers of this size 
are best suited to rather specialized applications in 
courses at the level we are considering, as they are 
generally unable to support the fxmctions mentioned above. 



THE ROLE OF C.A.I. 

If c.a.i. is ever to become r.ore than an c-xpon^iiv^" 
shov/piece or playthinr^, then the time, effort, and part-- 
icularly the expense that the use of thi;^ inedi'.i-i ^;r'T,ail'-, 
must be' clearly justified in terjnn of itc demor. ^ ".^rT - 
academic benefits. ' In this article I s?..nuid In '-co to con- 
sider some of the factors that affgct t;-.=- ur^ofii Im-.v- of'V.a.i. 
as a leariiing tool in courses presented at the uri' v^^r^'it-'-' -* 
or advanced secondary school level, giving sDecinl c.tt^ntion 
to several points that I feel often tone to he ovorlonlicd. 

The power of c.:a.i. as a learning too.!, man j rvrt-- it.^-elf 
in its interactive nature, itn aclapfcivc ai:-.i brur.:i. ip- 
abilities, and its record-koepinp; ability (to onab]e th--" 
course author to refine and linprovo ibe inbtructiT-na] ru'-.^-rial^ 
TTiese capabilities serve to define the usen to whjrh~ a -i " 
can be put in any given course. Thuc Uv: fact that roAputers 
cannot at present engage in extensive and meaningful free 
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dlaloGue limits the value .of c.a.i. in teaching history or 
philosophy (although the use of the computer as an information 
retrieval device should certainly not be discounted here). 

Just as intensive and meaningful dialogue demands 
direct personal contact between two or more people, there 
are other operations associated with the learning process 
that are better carried out by some means other than c.a.i. 
The transmitta-1 of information is a good example; books and 
mimeographed sheets are still the cheapest and most convenient 
way of conveying information of the kind that is required by 
all the students of a class. There is little to be s.aid 
for using ^ -c.-^, ij_system as a "page turner"-: students are 
rapidly bored by r6ng~Tea7tement-s-p^pes ente d on typewriter 
terminals at the normal -rate of 10 chararct-e-ra^per second. 
Perhaps the situation would not be so serious with^aTvideo--- 
display that could be generated at a faster rate, but even 
then, the student would probably want to have a hard copy 
of the printed matter for future reference. 

There are other ways of transmitting information that 
are all too often neglected, particularly when a glamorous 
technology like c.a.i. becomes available. It frequently 
happens that the spoken word is the most efficient medns 
of getting a point across, especially v/hen the commentary 
is directed at the explanation or clarification of a concept 
that is- simultaneously being presented by some other med- 
ium. This other medium is usually visual material- either 
printed or projected (or both), consisting of symbols 
or complete diagi^ams. If these diagrams can be assembled 
or made to evolve by means of animation techniques, then 
an entire new dirnension is available; in some cases the 
audio and visual media can be combined ./ith c.a.i. ct the 
terminal location, and presentation can te under co;.-.puter 
control. For other purposes, it frf-raently more -oracticai 
to prer.ent the audio- visual material of.r-line. vrnichcvov 
arrangemeno is follov/ed, it is iiTcorr.-.r-t that thp to'^ohpy• 
or course designer be fully av;arr' of -■; • - ivanv.-t -.••>:. ano l-i.-mit.- 
ations.of all these techniques. Tt vir: u<5nnliv h^- foiin^l 
that v;hen the various parts of the inG-tructjonal .load arp 
assigned to the different media in a -^c- v-irlviir-jvo way, 
then the overall learning system Is irir.vovod r'-r beyond 
what these media can offer v/hen U£.^eU iii iscUiLion. V/hlle 
this may sound very elementary. It gcc:.-?:- to be almor.t univ- 
ersally neglected in practice where c.a,i. is involvod- 
largely, I suppose, because the people v/ho develop c.a.i. 
systems and pro.srams are often priinarily interer.ted in c.a.i. 
itself, and their very specialization tends to shield them 
from this broader view. 



hall to^"„^5"*o%^-^''?^''^ ''U? 1^""^ f^^^^ students down the 
hail to use c.a.i. (or audiotapes do little better howpvpv 
no many instructors do not realize that these techniaues 

:xl?t'f L'rtu?b'a?ir'' ^-^^°P-^> powe^fullooL'^^hlt 
exert a perturbation on the more conventional assert c of the 

ta^^'iA ^^^^'"^^ " his e^2ginl'?IS Padio'''^ 

to tco^^in^?);J%S^^^ J? ^PP^y ^ "philosophy\f subtraction", 
in ?hp f?. ^^^J"*^ structure and what goes 

? '^''^^ re-evaluated every time a new 

medium is added. Simply tacking another learning tool 
S^«SinS existing and unchanging -regime of lecturls/ tutorials, 
learn?^^ and assignments does little to improve the student'^ 
mJ.^ J^o^ efficiency in tho course, although the novelty 

an^t^p/f ^Tf ^^u^^^:^^' ^-^-i- is treated as merely 

•another teaching "aid" without being integrated into the 

^J''^;??! !?/nS°?P''^2f?^^''^ manner, it seems unlikely that 
it will yield benefits enough to Justify its cost. 

a tPaow'^u.^r? optimum mix of instructional media and 
a teacher who is sensitive to the impact of these media 
■Svi?^ teaching of his course, one is still faced with the 

^f^/^^^'i^ ^^^^ primarily a self-paced 
o^ t^Jef ilnf^ °^ learning with che traditional two- 

o. -three - lectures-per-week lockstep format of the usual 
university course. To the extent that these Jndividuaf^ 
study methods are successful, the. amount of time devoted to 
formal lectures can be reduced- but here we come up agMns? 
the system": what happens to course credit ratings, 

^usSf?fn^°?fo,ni'"'^''?"^ all-importanrmeans of 

fh«^ fv^f ? faculty appointments? it is perhaps Just as well 
Sk^ so iZl flTf^'l..''^ an individual-stSdy course format 
take^ so long that these changes can generally be intro- 

^s^rat^Jsr^"'^' ""^"'^ upsetting deans and admL- 

availab????v^f ^^^^^ remark that I do not believe that the 
?1 HoS^-^^^y °f other media mean that the lecture 

IS dead, even in courses that are largely of the "training" 
type such as transls^r electronics of ellgJneSing'g^aphif s. 

It iG hard to conceive of any subject that does not have its 

dIs1?BMLc'"fnrf '^'iJ element^, its relarionslo'^olhe?"' 
disciplines, and Its patterns of development that can be-^t' 
be communicated by a living, thinking practlcioner of thit 
subject. The prmary function of thS SniveJsi?y teacher 
thusLsnor't'hp" these ideas, together with his Jwn en- 

subject, and to place what has already been 
learned in a proper perspective. The learning itself. 
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however, takes r)lace In the student's own frame of reference 
(and time scale), which is rarely that of the lecturer 
TnH °^ lecture, the sensitive* 

and Jiidicious use of c.a.i. and similar learning tools can 
i?o??'^..''ff^^ revitalize the classroom experience by "lib- 
erating" it from those activities that it could never 
accomplish very effectively. 

TEACHERS, AUTHORS AND PROGRAMMERS 

a « its-best, an extension of the teacher: 

?o f ^"f^ling the teacher's experience and sInsilJiity 

J?«^niT«\*^^ ^"^^^ learning. Because the ^ 

is so much more iiitimate and 

thit vpr^>.oc+ ^^''^i ^l^^sroom situation, it is important 
that the very best, teachers become involved in writing 
f'^lrhJ^^^ i^;. Unfortunately, very few experienced 
teacx.ers are willing or able to devote their time to these 

ex2e;d.'^?tJr'^:*'°^''^^' "teaching" con^i^ttment 

extends little beyond presenting three lectures per week 

??i,LnJr^!^''°"^^^' feeling by many faculty that 

V'^'-y^^^iy ^ali^re should not really need 
instructional aids (beyond the textbook), do littliTo 
nTl'l^lT activities. And the peculiar value system 

o?fPvc "publish and thrive", 

^nH^n^ii^^ ''^''^'"^ ^^'^ "^^^^^ to implement 

wlth^ ?^v^w'';^^■^^^f^ course; one doesn't even end up 

^^^^ "^^'^ claimed as a "publication" of 
protected by a meaningful copyright. f 

+y.c.^J^i^^J2 teachers directly involved in c.a.i., 

there is a tendency to delegate much of the v:rit3np- to others- 

f^^^^li co'nPuter personnel, inr,tructional pro- 
SvSr^f^ attempts almoct invariably fail to 

$p°c"S °^ satisfactory quality, for much the sane 

reason that none of these people would crbinarilv be equip- 
ped to write a good textbook or deliver a soric:;' of loctare- 

b2 ni^Jj" ^^""P^y "O"*^ ^'^^ enough oxT^erirnoe to 

ba aware of the multiplicity of difficulties that students 

of approach that can get the student over T:hese barriov^. 
and enQ9urage him to face more. 

1nvm5p''Jho''^ ^^1^°^ ^''^^''^ ^ ^^^Se number of teacherr. to 
is ?iBor?anf th«?%r''^/^^'^"^^^^y P^^^^"^' a/khorin.'^,, it 
wL +w « o ? they design their material in/ such a 
way that a maximum number of otljer teachers carT make use of 



dlffDreht gfouBS of stud^^?^+^ ^^^^^"^ to arrange, for 

■material in dlf?e?fnf trIjelto?i?s°or?„*!jIT'> l""' 

other special manner, '^^•'^'^tories or to be treated in some 

it is'nSrsSrprikmlhar?h5T/f " "^^^ computer. 

institutions ^?e o^rl^td th4 lo^arj^mSu^if T"? 

less comnonly. Departments br^FL;?Mes Srp*^??t?°"*'"^- ' 

a'r^St1?e^iraSie\??fc T |i" 

partment ot administrative Lrenrv S?^£''°?! =i"Sle Se- 

The role of the CompWim fen?re S*"?"! funding. ^ 

;ia"^%rrfIponslb!MtT?*'' O^A^^f^^entre. 
in the a?fdeSlcl?m ol tee Snivel development of e.a.l. 
it more closely ln?o1he*Ica^e'mlJ'^l?As??eL°f' '° 

SYSTEMS AND SOFTWARE. 

While comparatively r»rimitivp> ^ o •? - x 
.ately serve many tL?J?^^*J,-L^;;-^-.fyf,*™=.<=*" 



adequately se7^::"ahriL?^Sg"^u™c?i^:;-'-,f|J^"'^=- , 
is1o°^^a1^^^r?he^^f^*i- ill- 7,^s?S"V:.^l^\=o S???? ?iT,, 

It is unfortunate that nonp of th^ v..^,.^, 
c a. i authoring lan.^uag,os re?L'c?^?^ 

computing languages as it ^xlstl i nr "- ' • ^--p^ ' ^'^e-rtrt in 
thi.. is due, in larse%ea'-u?e i o • * ^^at 
ication between iSa^^rSo^f^ni^/U '••'^ ' ^^'"'"^^ 
with the problems Sf telehJ^i^roa] ' '"'V'^Ji' -"-'^^-'^-^ 

and the teachers, whoso P-Pnp?«T f"^'-"''-"' ive stu^iontr), 

computing science leaves J^^rnn ''' V""' ^ •'^'^'^"'^y ''^^^ 
reasonably ask for unaware of wiiat they could 




All of the principal c.a.i. authoring language'^ are. 
In my view, lacking in character string processing capabilities 
that are, essential for adequate analysis of student res- 
ponses. ^Qihers are deficient in arithmetic computing 
faeilitles. Very few languages are generalized enough to 
support a variety of terminal types (both typewriter and 
video , display) , nor do they commonly allow for the pro- . 
gramming of additional functions and capabilities at other 
than the assembly (or FORTRAN) level. 

The effect of this is to seriously limit the applicability 
of c.a.i. to the kinds of tasks that it must perform at the 
advanced high school or college' level. Authors are forced 
to fit their instructional strategies to the Procrustean 
bed of an inadequate language, and thereby degrade the 
entire functional capability of the c.a.i. process. .Extreme 
examples of this are seen where- non-c.a. i. languages such 
as APL or BASIC are employed for c.a.i. purposes. What 
makes this situation so maddei^ing is that many of the things 
we want, to do can easily be done by a combination of lang- 
uages that presently exist - the problem is mainly one of 
merging these capabilities into one single language. Some 
individual centers ha.ye begun to do this; Western Washington 
State College;- for example, 'has merged IBM's Coursewriter 
III (which lacks decimal- or floating point variables)^ 
with their Pl/l - derived on-line conversational computing 
language, thus adding both arithmetic calculating and string 
processing capabilities to Coursewriter. 

But this brings up another difficulty- that 6f in- 
compatability between program materials from different 
institutions. Very few institutions will be able to command 
the interested faculty and the resources required to dev- 
elop, on their- own, all the c.a.i. programming they could 
profitably use; the time and effort required to v/rite, 
debug, evaluate, refine, and maintain a complex c.a.i. 
program is so great that it would be a waste of resources 
to expect each institution to do this for every subject 
anyway, ihere must he exchange of materials b,otv;eon 
orf;anizations , and thirj requires a certain amount of uni- 
formity. Not total uniformity, v;hich would undoubtedly 
impede progress in the r.tate of the art, ;-.o not a single, 
universal lanf!;uage- but not a huntired different languages, 
either, and the latter situation is a more accurate des- 
cription- of what we are up against today, 'mere is an 
unfortunate tendency for ihdlvidual university comtDuting 
groups to write their, own c.a.i. languages- so often it 
seems, without any reference to (or even awareness of) 
the academic .functions the language must serve, or the 



advantages and disadvantaees of n+hor. « „ • •, 

What usually results inZt ano?Srund?s't iniuffi" " 

oAly'io'?^?^f|'?L*'Lsl3Iut\'r?' '"V" 

to be getting worse > Panin+,r 1 panada, and it seems 
, devoti^ la?|e amounts of ?w ^f"" interested in 

that haf littfe possibiJiti^? Jse HL^^E^^ programming" 
bill of fare becomes overlade^wflh thr^^^ ^-^-^ 
?oTs^^?£^e\?SS^^^ "XnL^oSr^ -f- ^f 

disc^s%rSl?e%n'tMs-i;^^"'^S"^ '^^^^^^^ are 
mention on!y iSle geLSi%o?nyf Karl Z inn, to I will 

nothing tha?- putra^\"^5ent^1f L?l^'kn^^''^^ve\\': 

language should be cap^blfo? ?Icoln^S?L*^^ Programming 
fragments embedded in othir L?l??f? fJ^thp^!:?'*^" ?^ 
tl'oTll'lt\^^^^^^^ anTtL^re^ 

«es°e^ ^££SB3^'^^^ etc., 

to do these things oWS^ieJtw 1= inability 

of the less sophistiSted c a ? ^^'■^^ of some 

and BASIC "^"'1= 'floated c.a.l. languages, and of APL 

V 

detert^S^h^wLtf ^nVf ^ " ^onvenient means of 

to prov^eX?u°a?e*^JSn^fLL%°f^?^cognI?^S '"'l^?! ''^"^"^ 

;i?L^rins°^ir(o^i?L??==^\^^^^^^ 

;ros£^iJ°|i\r= — .as .l/tU^^roA^^^^.x 

Finally, i^re are many instances vhoro i+ . • 

to employ audiotape or visual hi 1^.11, ^'V oe.vir'..- le 

the auxuia^ e^SS^n?-lf ?|3?l?tS%"I1?a1?|?aI"' 
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Wc have found that a less elegant, but thoroughly useable 
slide projector control can be effected by indirect means 
throuch an ordinary terminal. For example, the typeball 
of an Selectric terminal can be used to operate micro- 
switches (at the far right-hand margin, beyond the usual 
typing area) that control forward- and reverse movements 
^ of an ordinary projector. Similar control from a video- 

tube display can be had by mounting miniature photocells 
\ on the face of the display tube. While audiotape devices 
can be controlled in the same- way, we prefer to use the 
audiotape (or tone signals recorded thereon) to control 
the pacing of the c.a.i. program in such a way that the 
^ student alternates between listening segments (presented 
with slides) and brief c.a.i. exercises that reinforce 
teach of these segments. 

. One new display device that appears likely to become 
quite popular (and may even displace TV ajid conventional 
cin6 for all but large group instruction) is the Philips 
'P. I. P." system, which consists of a Super-8 film trans- 
^ port that is. activated by tone signals on an audiotape. 
1 Both the audiotape and the film fit into convenient cas- . 

scttes, and film advance can be as rapid as 24 frames per 
second, permitting complex animation displays in full 
color. Sinc.e the film is moving only when motion must be 
depicted, txie system is very economical. We are- orosently 
investigating the possibility of interfacing this* device 
with a conventional c.a.i. system, and believe that it 
> can provide an inexpensive means of presenting a display 
-^xOf a kind that will not be economically feasible on a 
I direct computer output device for many y^onr:? to come. 
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CAL TERMINALS - SOME RECENT CANADIAN INNOVATIONS SESSION 2A 

« « w ; u ^ . ROOM/fiALLE 1A3 

By/Par: Peter M. Carey, John Tate 

Lektromedia. 



Inadequate terminal facilities has been a major impediment to the 
development of effective communication between students and course materials and 
hence to any widespread acceptance of CAL as an instructional aid. 

This paper will describe some recent advances made in Canada in terminal 
design and will be illustrated by operating multi-media terminals of Canadian design 
representing- the Ic^test state-of-the-art. 

The areas of economic graphics , random-access audio /visual and touch sense 
interactions will be covered. The papp*- will relate a terminal's inter-active commun- 
ications facilities to the possib"'e instructional strategies, and to the overall costs 
Involved. 

Special reference will be made to considerations for authoring and 
editing multi-media CAL materials. 

QUELQUES INNOVATIONS CANADIENNES r€cENTES 
DANS LES TERMINAUX PES ORDINATEURS PEDAGOGICUES 

Des terminaux inappropries sont ^ la base des obstacles majeurs au 
d§veloppement de relations ^'efficaces entre les etudiants et les ordinateurs pedagogiques ^ 
et, de ce fait, ^ 1 'acceptation, repandue de l' instruction ^'I'aide d' ordinateurs. 

Dan? cette communication, nous decrirons de recents progrSs, au Canada, 
dans la conception des terminaux et nous illustrerons ces progrSs en -foisant fonctionner 
des terminaux ^ affichages multiples de conception canadienne representant la technique 
la plus avancee. 

Nous- examinerons les domaines des graphiques economiques et des^ interactions 
^ volonte et aleatoires de 1 'audio-visuel . Kous etablirons.^un rapport entre, d'une 
part un terminal conversationnel et, d' autre part, les methodes pedagogiques et les 
prix de revient. 

\ Nous parlerons specialemen- de la constitution et de I'edltion des cours CAL. 



TITLE : C^PUTER AIDED IMRNING - STUDENT TERMINALS 
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SUMMARY 



This paper describes some recent advances in computer 
terminals for CALand other high-level inter-active 
uses. The work stems from our contention that the 
lack of appropriate temjinals is impeding the advancement 
of CAL Recent developments include CRT temiinals with 
graphics, special fonts, and audio-visual media attachments 
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' ino o?oIiLT r <'PP'^«d in Education, Computer Aided 

ng prom«es to have the most profound impact, -even though it is still in 

tJ^h I • ^T'S'?" at Lektromedia, are ^ 

-^able^ere.i«Klequ<^e^for-eM^^ It was the fob of technologists 

to invent tenninals specially for CAL and that until this was done then CAL 
would not be taken very seriously by teacher or students. 

T»,« *° °^ temjinals used for CAI were teletypes 

dia<^ since all mteraction must use the printed wod, usuallyatan 

IhT^H T . ^"^^ "'-"9 but even 

?kTtZ '^"'"r/'^f ["9 '"■J^n^ed and still used only the printed word 

more !ln^^ ^^"^^^ '''"^ ^""^ ^"'"^ ""^ and, heedless to say, 
more expensive. 
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One of the First questions we asked was, - "IF you have a 
CRT. isn't some material better presented in graphical or pictorial fomi ? 
People get quickly bored if everything is presented in text form", -Witness 
text-books without any illustrations I Another Idea we pondered , -with due 
respect to efficiency experts ) - was "Don't write it, -say it" — and so 
our "talking terminal" came into being. 

In response to the first question, I will summarize our approach 
to squeezing "the most for the least" out of a CRT, You can get an 
inadequate Text-only CRT for about $ 2,000 and an over-elaborate 
graphics CRT for $ 20,000, What we wanted was a better compromise 
between perfomiance and costs, i.e, - a lot more perfonnance for a little 
extra cost ( than the cheaper units ), 

So, we invented what came to be nicknamed "Lektrographics", 
JThh is a graphics generation technique using a 6 -bit coded font which 
can be stored and transmitted the same as ordinary text. We reasoned 
this way; "why pay $ 20,000 for precision graphics when for a few 
hundred dollars you could have something nearly as good which is suitable 
for most. instructional uses ?" Lektrographics is just that, - it is an 
"electronic blackboard" that can be used to illustrate concepts effectively 
although not to any great degree of precision, 

Uktir^raghics-(T>a^^ pending ) is based on drawing a diagram 
by joining up^djocent characters using a 6 - point and 4 - bar font. The 
dots and bars fill the location nonnally occupied by a character with jts 
surrounding spaces so^ adjacent graphical characters can adjoin to make 
continuous lines; Curves are approximated by plotting the best approxi- 
mation of points, ^ 

Using thii^ technique, a graphic diagram can be combined with text 
in CAL sequences and the " level of communication" to the student is 
noticeably enhanced for a very modest cost, 

\. 

We also felt it was important to make the graphics easy for 
teachers to prepare in f|ie authoring and editing^ stages, - If otherwise, 
then it wouldn't be used. Terminals are physically anxinged so that any 
unit can present g raph ics\ in the student mode. To mithor graphics, the 
teacher plugs in a small rA^imic-style composing board, TRis not only 
prevents students from n.od^ying a graphic but also optimises the price 
because only one composing board is rJeeded among several tenninals. 



The next question we addressed was the need for temiinals to 
present material using familiar symbols so that they are easily comprehensible 
For example, most terminals present text written only in upper cose which 
IS unnatural; nor can they produce conventional mathematical qnd scientific 
symbols. These limitations detract from the ability of the CAL to teach. 

So we designed a programmable font. Ulce the graphics, this 
provides full-font characters but on interchangeable modules with 
characters in groups of 16. You can have, for example, a bilingual 
upper/lower case set with French accents such as g, 6 , etc. You can 
have two full alphabets for language instruction, say French-Russian 
You can have sub-«cripted and exponential characteR. You can have 
mathematical and scientific symbols such ^ x2 x 

•TT, etc. or special symbols such as ApL commallds. ' These chaiicte^ 
sets can be interchanged so that a tem>inal assigned to, say, mathematics 
instruction can be converted to, say, physics or chemistry simply by 
putting in the modules appropriate to the course content. 

The next problem centered on the presentation of visuals 
because the instructional value of CAL curricula ca. be greatly enhanced 
by Msing slides, film or T. V. These must however,he-random1y ocf^Tble 
If the ful I adaptive power of the compyter-ls-te'Bi of value. 

So we designed the terminals to accept and display T. V. images 
and also to synchronise hto a T.V. system so that T. V. pictures can be 
combined with terminal data. 

We then designed a random-access si ide selection system This 
at present accomodates up to VOO - 35 mm slides but can later be expanded 
to rnc lude strrp-film , - still frames or movie. The temjinal displays the 
optical image immediately adjacent to the coniputer-generated ( CRT ) 
image giving the overall appearance of a single screen with side-by-side 
images, ^ 

This aijproach was taken partly to enable the student to view 
both rmages together (since usually they are related ) and also.so that the 
full screen can be made responsive to touch. For the student to always enter 
hrs "-esponses and questions through a keyboard is very restricting, especially 
to small chrldren who often can't spell. The touch-sensitive display allows 
a very natural and effective dialog since the student can touch his finger 

nllv J'u. °' 9^ '^9*- ^«"P"^«^ discriminate the 

posrtron of hrs f mger to about ]/]0" , -accurate enough for most purposes. 
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The touch-sensitive device was originalfy invented at NRC 
but is still nanewhat expensive. Despite this^ we have shown that it provides 
a powerful input device and either it^ or competing devices^ will soon be 
Feasible for general use. 

Perhaps our most significant innovation is the "talking terminal". 
This is a casette-based random-access audio system built into a remo\'e 
teiminal. Each casette holds up to 100 individual messages of 60 minutes 
total playing time. Maximum access-time is 60 seconds^ end-to-end ^ although 
if messages are organised effectively^ an access-time of 1 - 5 seconds would be 
more noimal. The audio quality is excellent, in fact, it is almost hi-fi 
reproduction. The audio terminal is "smart" in that it contains a micro- 
processor. This is a "must" in handling Hie audio system but also serves as 
an effective means of header-word processing, slide and touch panel control 
and implements certain CRT editing and formatting functions, 

Ths micro processor is programmed to operate the audio system 
In either student or author mode. Physically ail audio tenninals operate 
in the student mode. To do authority, you plug in an extension authoring 
board into any student terminal. * 

In authoring, the terminaf is placed off line and can be used to 
generate new tapes or edit existing tapes. During authoring of a new tape, an 
index containing the start and stop address of each record is generated and 
resides on the tape itself. During the editing phase this index is updated 
continuously. By means of the index, all call-up of messages by the 
CAI programs is by means of message number (00 - 99 ). 

The student mode s^tarts with an initialization whereby the index 
is automatically unloaded from tape into the teiminal memory. At this time, 
the identity of the tape is checked against that required by the CAI. ' When 
the CAI program subsequently calls up a particular audio message, the 
index is used to detemnine the location of that message on the tape, search the 
tape at high speed, play the message and stop at the end of It. 

At Lektromedia, we believe that in order to be cost effective in 
future, it is desirable to adopt a system approach of concentrating teiminal 
control into central units which may drive a cluster of local teiminals. This 
will reduce hardware costs and more significantly, allow remote operation of 
the whole cluster over a single high speed communication link. 
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The designs we have described have been packaged into two 
basic models of terminals, known as UEK 110 and 120. The firet includes 
only the various CRT features. In this case, the programmable fonts and 
graphics are accessed v\a Shift-Out / Shift-In control character. The 
second model, LEK 120, has all the same CRT features but also includes 
audic/visua! and touch screen facilities which are accessed by means of a 
heoder^ord syaenu^^ll models can be operated remotely from the 
computer over^s-td^hone line. 

All the development work of these terminals has been done in 
Canada in consultation with NRC with particular emphasis on technical 
standards. This is to ensure that any terminal will operate with any 
computer and that curriculum software can be intern-changed among users. 
In this regard, the communication coding is important, particularly 
in regard to lhe coding of functional controls and the French accents. 
A unifonn heoder-^ord format for remote multi*<ievice terminals has also 
been followed. 

It will be evident that these tenninals enable the communication 
between student and CAI material to be at a very high level , -compared 
to previous technology. Thi' ^^enrnits a much more comprehensive and 
natural dialog and greater flexibility in selecting among alternate 
strategies for instruction. 

For exampl^, the graphics offer a low-cost but very powerful 
means of communicating with pictures as well as woids. A terminal 
without graphics is like a teacher without a black board. The programmable 
font makes mathematic and scientific instruction practical rather than 
clumsy. The audio and foreign olphabets mean that language instruction by 
CAI can now be considered seriously. The random-access slides and touch 
sensitive screen open the door to widespread use of CAL for small children. 

It is by using a high-level communication in combination with the 
full adaptive powers of the computer and sophisticated curricula design 
that one can make CAL truly "effective".' 
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Now, a word about cost. -How can one answer the common 
complaint, "It's too expensive". -What should a temiinal cost? 
Where are t hese "low-cost, do^verything" terminals that'everyor^Hong^ 
their hopes on ? -Let me just say that the tenninals described herein 
are here today and they work. They do indeed cost a bit more than 
devices which are of no use I The overall cost of a CAI must be 
related to its effectivity, i.e. , Does it teach ? An overall CAI 
installation built with effective tenninals and programmed to utilise them 
fully will cost more than a CAI system with cnjde tenninals having 
significantly less teaching value. Nobody has yet incorporated a truly 
effective CAL system into the educational system, for enough time, and 
spanning enough material to realise any real pay-off. I can confidently 
say that these tenninals^ allow the high-level of communication 
necessary for effective CAL curricula and that they are absolutely 
unique. 
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THE ROLE OF THE MINICOMPUTER IN C.A.I. SESSION 2B 

By /Par: P.A.V. Thomas, ROOM/SALLE 143 

University of. Windsor 
This paper will deal with the concept of using a specially designed 
graphics system that is being developed about a minicomputer to appraise the capability 
of carrying out computer aided instruction at a modest cost in remote locations where 
it may not be possible to provide a large scale system with time shared terminals. At 
this stage juost of the system hardware has been constructed and the software has 
commenced. The system is constructed about a 12-bit word mini-computer with a 4k-core 
memory; the graphics facility consists of a logic character generator with a high 
degree of flexibility, a line generator, a 4k-^core refresh memory, 8" x 10" display 
tube and a light pen. As back up storage for display files, a magnetic tape 
cassette drive is included in the system. For interactive working there is in addition 
^to the light pen, a teletype and a set of push buttons. By providing hardware generators 
the amount of data storage is minimised and their novel design is such that they could 
be easily produced in quantity by L.S.I, techniques thereby keeping the cost to a 
minimum. 

LE r8le du mini-ordinateur dans L'EAO 

On traite du syst^me graphique specialement congu pour un mini-ordinateur 
afin d evaluer la possibility d'effectuer 1 * instruction ^vl'aide d'ordinateurs ^ un 
prix de revient modeste, dans des endroits eloignes oD il n'est peut-Stre pas 
possible de foumir un grand syst^me avec des terminaux S temps partage. Actuellement, 
la plupart des composantes sonc construites et on a commence ^ f^ire la programmation. 
Le systfime est construit autour d'un petit ordinateur S mots\de 12 bits avec une 
memoire en tores de ferrite de 4K mots; la partie graphique ^e compose d'un 
generateur de caract^res logiques tr^s souple, un generateur 'de lignes, une memoire 
ne rappel de 4K mots, un ecran de 8 X 10 pouces et un crayon luraineux. On dispose 
da memoires secondaires ^n cassettes pour les dossiers d* images. Pour les 
conversations avec I'ordinateur, on dispose du crayon lumineux,*d'un teletype et d'un 
grcupe de boutons poussoirs. En fournissant des ^oiiipements generateurs, on minimise 
1 ei-magasinage des donnees et, grace ^ leur conception originale, on pourrait 
facilement les produire en quantite par les techniques de microminiaturisation et 
ainsi reduire au minimum le prix de revient. 



\ 



-83- 



ABSTKACT 



This paper will deal with the concept of using a specially designed 
graphics system that is being developed about a minicomputer to appraise 
the capability of carrying out computer aided instruction at a modest 
cost in remote locations where it may not be possible to- provide a large 
scale system with time shared terminals. At this stage most of the 
system hardware has been constructed and the^ software has commenced. 
The system is constructed about a 12-bit word minicomputer with a 4k-core 
memory; the graphics facility consists of a logic character generator 
with a high degree of flexibility, a line generator, a 4k-core refresh 
memory, 8" x 10" display tube and a light pen. As back up storage for 
display files, a magnetic tape cassette drive is included in the system. 
For interactive working there is in addition to the light pen, a tele- 
type and a set of push buttons. By providing hardware generators the 
amount of data storage is minimised and their novel design is such that 
they could be easily produced in quantity by L.S.I, techniques thereby 
keeping the cost to a minimum. ^ 

\ 

1 . Introduction ^ 

Before describing the details of the system developed at the 
university of Windsor it is desirable to consider some cost factors. In 
a recent article by Pottle et al [1] a comparison of costs is given for 
their QDC 3600 system wi.th 60 teletype ports and an estimate of costs 
for two minicomputei configurations; their figures are summarist^d in 
the Table below together with an estimate of the total cost with main- 
tenance. It should be pointed out that these costs were for local 
systems not involving long distance line costs. The interesting thing 



SYSTEM 


COST/USER HR. 


TOTAL COST 


TOTAL COST/_ 
USER 


CDC 3600 
DEC PDPll 


$5.00 
$3.30 - $5.00 


$ 2 -'3M 
$30 - 40K 


$25 - 40K 
$30 - 40K 



TABLE - COST COMPARISON 

to not 5 is that the user costs are comparable for both systems, however, 
there will obviously be greater "computing power" in one CDC3600 than 
60 minicomputers so that one cannot consider the two systems identical, 
though for many instructional purposes they could be considered as 3uch. 
If one is only considering the teaching of computer programming one 
could conceive an" even cheaper system costing about $6000 with a user 
cost of about 60^/hr. and at the other end of the spectrum there is the 
PLATO system developed at the University of Illinois costing about $5M 



r 
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and claiming projected \iser costs as low as 50<:/hr. Further similar 
figures are given in another article by Howard et al ^2] . The main 
point to bring out here is that the user costAr can be of the same order 
irrespective of the size of the system but the initial cost can only be 
jxistified if one has a large number of xisers (or possibly other uses) 
for the system. 

Given a large justifiable capital sum then a large system will * 
probably be more flexible and powerful than a large nximber of mini- - 
computers, but if the capital sum available is limited, then using 
one or two miniconputers will give similar, user hourly costs. With this 
background it seemed a worthwhile venture to appraise the CAI capability 
of a small system costing under $20K for in this way a small establish.- 
ment far from a large computing system would be able to take advan'tages 
of CAI (possibly in a resource centre) at.^odest cost. 

2. Overall System 

The overall system shown in Figure 1 was designed to give maximum 
flexibility in order that different features oould be tested out — 
specifically a CRT with refresh memory, is usee rather than a storage CRT 
so that a light pen could be used for interactive purposes. It was 
decided therefore that the complete system would consist of a PDP-8 
minicomputer, a display tvbe with refresh memory, light pen, keyboard 
and ultimately a magnetic tape back-up memory. Due to the desire to 
use a refresh memory and yet be able to display a reasonable amount of 
data in any one frame, hardware generators were developed to produce 
the various data forms, specifically, an alphanumeric character genera- 
tor and vector generator. 

3. Data Form " % 

Before considering the details" of the system it is necessary to 
describe the form of the data \ised in a display. Essentially this can,^ 
be said to consist of three types: (i) data applying to a particular 
item, be it alphanumeric character or a line segment, and' referred to as 
an Item Data, (ii) data applying to a particular mode which energises a 
particular graphical generator and referred to as a Mode Data, and (Hi) 
a Jump Instruction (Jump Data) which permits a particular display file to 
be regressed or entry made to a new file. There are a number of methods 
used to organize such a display file and due to the short word length of 
the particular computer (12 bits) , these three types of data each occupy 
one word in a display file. This naturally leads to three different 
types of data format which are shown in an Appendix. It will be 
observed that the item data always begins with a zero and the "control 
instructions" with a one. Furthermore the second bit of an "instruction* 
is a zero for a mode control and a one for a jump. This coding assists 
both the hardware design and also the user for programming. 



\ 
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The primary purpose of this buffer is to match the speeds of the 
input/output (I/O) transfer of data through the computer approximately 
4000 words/sec) to the graphic item generation (lys to 40ys) . Various 
forms of buffer storage were considered, that is, drums, discs, delay 
lines, and core storage with respect to speed and the required capacity 
which should not be less than 2000 words. The ultimate decision was to 
use a core memory of 4096 words similar *:o that used in the computer. 
This not only gives adequate .pace but alvo eased the design. 

Associated with this memory there are two single word buffer 
registers and two addressing registers for loading of data into the 
memory from the conqputer and accessing the data to the >^ario\is graphic 
generators. Furthermore having accessed the data ftom the memory it- irs 
necessary to have a Controller capable of interrogating the data and 
determining the required action. The complete system, shown in Figure 1, 
has been fully described elsewhere [3] and will be only briefly described 
here. ' 

When initially turned on the system is essentially static. A 
computer override command w\ll normally be given from the computer 
through a device selector ^to the Data Flow Controller (DFC) , to give 
the computer complete control of the memory. Under these circumstances 
the normal sequence is to first load into the memory I/O Address R -ister 
(lOAR) the location of the first data item to be loaded using a Memi ry_. 
Address Load command. Following this an Input Load command is given 
which transfers data from the computer to the I/O Buffer (lOB) and then 
triggers a write cycle of the memory to transfer the data .from lOB into 
the memory location specified in lOAR. This process may be repeated as 
often as required; however,- in practice if a file is being Ipaded all 
data will occupy sequential locations so that automatic incrementation 
of lOAR may be initiated using an automatic increment lOAR command there- 
by saving the time of continually loading lOAR. 

When a file is completely loaded and a display is required, the 
computer override is turned off which automatically starts the refresh 
side of the memory with the Display Address Register (DARj^and Buffer 
Register (DBR) cleared. The first read cycle froiii the memory therefore 
automatically starts from location 0 and transfers the contents of this 
location to DBR. 

Typically there may be a number of different display files as shown 
in Figure 2 in the memory at any one time so that the item in this first 
location (0000) will normally be a jump instruction to the beginning of 
thfe^sired file. As seen in the Appendix, two types of Jump are 
availably; the reason for this- is that the direct jump is* limited to 
256 memory^ locations (due to thfe 12-bit word length) whereas a fi:e may 
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be l^^^ger than this and certainly located more than 256 words from the 
beginning of memory. The indirect jump permits jumping to any location 
but requires two memory cycles. Furthermore, when using the direct jump 
a page bit (bit 3) is used to indicate a common zero page or the current 
page (each page being 400g locations). Normally, therefore, the first 
location will contain an indirect jump, detected by bits 0-2 being *1* 
and the next word is accessed to obtain a pointer address to which the 
jump is to be made. If on the other hand a direct jump were used the 
core location portion would be transferred into the DAR^ bits 0-1 being 
cleared if the page bit is zero. 

The next item to be accessed will generally be a Mode data and will 
be decoded as such due to bits 0-1 being 10. This '-"ill turn on the 
appropriate Genera^r (A/N, Vector or Dot, to^T^e described later) and 
set condition flip flops particular to that generator. At the same time 
the DAR is automatically incremented. The next item of data is then 
immediately read into DB;^ and in this case will normally be an Item 
data which is detected as such by bit 0 being a 'O*. The active genera- 
tor is then checked for readiness to accept data whenco the data is 
trfimsferred to its own buffer register; ""again DAR is incremented and a 
memory read initiated. Further Item data are displayed until another 
Mode data is detected when either the condition flip flops in the active 
generator may be changed or the active generator is turned off and 
€mother turned on. This process continues until emother Jump is detect- 
ed; normally this jump will be a direct jxamp to^ location 0 which then * 
refreshes the^ display file. * 

If now the file has to be modified, control can be returned to the 
coruputer by mean?' of the computer override feature mentioned earlier. 
Alternatively "cycle stealing" may be xised by giving an Input Load 
Command which loads lOB and signals a Request to DFC. As the refresh 
side is asynchronous and Cata generation may take a greater time than 
a memory cycle (8 vs) , further data cannot be supplied to the generator 
buffer; the I/O Request is now detected and the contents of lOB written 
into memory location specified by the contents of lOAR. 

Having described the methods of memoir/ access by the computer ahd 
display tube, it is appropriate at this point to discuss the method of 
interaction using a light pen. A light pen register (LPR) ^normally tracks 
the current value in DJ\R; if however a light impulse is received by the 
light pen emd the j)articular item being displayed is light pen sensitive- 
(determined by bit 9 of the last Mode word) a signal is. supplied to DFC 
which generates a program interrupt to th'^* computer and inhibits cmy 
further chemge in LPR, whilst allowing the display to continue. o In 
response to the interrupt the computer can then read the contents of 
LPR through lOB; this identifies the item "picked" by the light pen, and 
the user can make any required chcinges tnrough the computer. After 
servicing tJie interrupt the LPR is reactivated so that it continues 
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tracking I^AR. 

c 

5. Alphanumeric Character Generator 

The alphanumeric character generator is. a 5 x'V^dot matrix generator 
that was implemented entirely with NAND logic and described elsewhere 
[4,5]. Briefly, the matrix is formed using Y- and X-up-down couiiter 
registers feeding digital/ analog converters "(DACs) the former being*^ 
incremented up to 7 by the main clock and the latter being incremented to 
5 on each 7th pulse and a further double count after this to provide 
spacing between characters; at the same, time ^ brightening pulse train 
is generated according to the character to be displayed. 

Three sizes of cnaracter are available, the size being controlled 
by altering the counting position of the lOrbit X- and ^j^^oxinter 
registers. Basically this permits a display area of 1024% 1024 raster ' 
units; in the case of character- generation the smallest size uses incre- 
ments of 2 raster units/dot, position of the matrix but altering the 
coxinting to the 4 and 8 bit positions the character size is doubled or 
quadrupled permitting 3 character sirzes, \inder program control. Further- 
more a small character normally considered as a subscript may be moved 
up one character height for superscripting purposes. Due to this method 
of generation it Should be pointed out that there is a minor limitation 
in that a character can only be positioned at discrete positions, being 
a multiple of one character size. 

The ASCII character to be displayed is loaded into a Character 
Buffer, 7 bits in length, whereas only 6 bits are used for the character 
selection. The reason for the 7th bit i3 to allow for certain special 
characters, back space, line feed, character return (corresponding to 
carriage return on the teletypewriter) and tabulation which have similar 
6-bi t codes as some of the alphanumeric characters. In these cases all 
7 bits arc decoded and if a special character is decoded^ character 
generation is inhibited. The operations performed are self explanatory 
and will be only briefly mentioned. Line feed may be sing'le or douMc 
depending on the value of bit 4 in the data word which'' controls the 
decrementing of the Y-counter register. In the case ot character 
return the return is again controlled by bi", 4, being to tho left hand 
margin (by clearing the X-counter register^ to zero) or tn one of 8 
positions equally spiced across the screen depending on the value -(0-7) 
previously set in a special 3-bit Margin Register. This register* is «^et 
by a Data word u/hilst in the alphanumeric mode) having the desired 
number in its Hits 2-4, the remaining bits being- zeirq corresponding to a 
'Null' character which is also a special character ^d detected as such 
to inhibit any generation. Tabulation may also be performed and auto- 
m'atically places the following character at the next margin position* 
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6. Dot Generator 



It is intended to prt)vide two methods offline drawing, 5Hese being 
a Vector Generator and a Dot Generator, the former being relatively slow 
compared to the latter, but more flexible in line positioning. The dot 
generator, cis constructed permits a dot to be generated after incremen- 
tation and/or decrementation in both the X and Y direction by 0, 1, 2, 
or 4 raster tmits, this being achieved by counting at the appropriate 
point of the X- and Y-up-dorvn cotinter registers. Furthermore a series 
of equedly spaced dots up to a maximium of 15 in the same direction may be 
generated by loading a repetition coianter, within the g^ner^or, with 
the number specified in bits 2-5 in the data word. \ 

In addition/ a vector generator tising analog integrators is under 
construction which will generate lines of any length, and at any angle. 
At this stage^nly^point or positioning— is~possii>l^—in-th^is mode, this 
being carried out by loa'^ng the required absolute values of X and Y 
into the corresponding counter registers and applying a brightening 
pulse after the DACs have settled in the case of the point mode. 

•> 

7. Blrightness Control 

Three basic levels of brightness will be available, these being 
set by. bits 10-11 of the Mode words;, furthermore when the vector genera- 
tor has been con^leted a paurticular line may be blanked out by bit 1 of 
the X-data word to save unnecessary vector mode words. A further feature 
is required when in the alphcmmneric mode to compensate for the character 
size. When chancjing character size the appsirent brightness of a 
character increaises as the size is reduced due to the dots being c^^ser 
together; to condensate for this 3 more levels are required, thesr ^eing 
under the control of the size bits of the Mode and Data words. One 
other factor that effects the brightness of the display is the length of 
the file which caxises a veuriation of the refresh rate, the rate decreas- 
ing cis the file lengthens. To c arcome this the file length may be kept 
constcmt by- filling the xinused portion with Null characters whilst in 
the alphcmumeric mode*^ This, however, is inconvenient and wasteful of 
buffer memory space, so that a frame synchronisation feature is made 
available in the vector mode word (bit 6); by sensing this bit a picture 
frame may be started eveary l/SO second irrespective of the length of 
the file, this being the longest practicerl time to prevent flicker of the 
display. 

The only other feature provided is provision for 'blinking* any 
Data item by setting bit 1 of the data word. In this case the effective 
refresh rate for these data items is reduced to 3-3/4 frames/sec which 
gives a satisfactory flicker. 
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8. Results 



Although the supporting software has not yet been developed, some 
displays are shown in figure 3^ specifically (a) shows the complete 
available character set and (b) the 3 different character sizes; this 
also shows the ability of superscripting which is particularly useful 
in algebraic expressions, (c) and (d) show the hardware tabulation and 
variable margin return useful for columned data, (e) and (f) show the 
use of lines mixed with alphanumeric data as may coiranonly appear in CAI 
material. 
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MEMORY LOCATION 

0000 
0001 
0002 
0003 
0004 
0005 
0006 



0112 
0113 
0114 
0115 
0116 

0117 

I 
I 
I 
I 

0400 
0421 



contents' 

JMP I 

PTR to absolute address of file 
VECTOR M0DE> (position only) 
X 

y 

VN MODE 
A/N Code 



JMP 0000 . 
VECTOR MODE 
X 
Y 

A/N MODE 
A/N Code 



F 
I 
L 
£ 



JMP 0000 



F 
I 
L 
E 

II 



Figure 2. Typical Display File 
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PENDIX 
Data Forms 



MODE DATA 



Vector Mode. Bit positions 
0 1 2 3 4 5 6x7 8 9 10 11 •J 



1 


0 0 0 0 




T 


L 


I 1 



Dot Mode. 



1 


0 0 0 1 




L 


I 



Alphanumeric Mpde. 



1 


0 0 10 


M 




s 


L 


I 



JUMP DATA 
Direct Jump. 



1 


1 0 




Core Location 



Indirect Jump. 

ill ii 



ITEM DATA 

Vector Mode. 2 words 



Dot Mode. 





0 


B 


R 




AY 


Alphanumeric 


Mode. 






0 




SS| M| 


7-bit ASCII 


Margin Load. 




0 


MS 


0 0 0 0 


0 0 0 



Symbols used 
F : 0 - No firame synch. 

I - Frame syuch. on 
T : 00 - Position only 

01 - Dot at tip 
10 - Dashed line 

II - Solid line 

L : 0 - Light pen insensitive 

1 - Light pen sensitive 
I : 00 - Normal 

01 ^ Dim 

10 - Bright 
M : 0 - Normal 

1 - Load next word into 
Margin register 
S : 0 - Normal size 

1 * Double size 
P : 0 - Page Zero 

1 - Current page 



0 


z 


X co-ordinate 


Z : 0 - Normal 


0 


B 


Y co-ordinate j 


1 - Blank (overrides I) 



5 



R : 
SS 



0 - Normal 

1 - Blink 

1 - 15 No. of repeats 

00 - Normal 

01 - Superscript 
10' - Subscript 
11 - Capital 

M(CR) : 0 - Normal 

1 - Column return 
M(LF) : 0 -Double space 

1 - Single space 
MS : 0 - 1st. position 
to 

7 - Sth.position 
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A MODEL OF A CENTRALIZED CM SYSTZM SESSION 2C 

Rv/Par. vrsi^^i- c 1/ t ROOM/SALLE 143 

By/rar: Robert s. McLean 
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Studies .in Education 



This paper is a preliminary report of an anlaysis of a computer-assisted 
instruction system consisting of students located at a location remote from the central 
computer facility and communicating with it through a common data communications 
channel. The analysis is based on a computer model of the system developed by 
O.I.S.E. and N.R.C. Tlie model examines the requirements of the data communications 
channel to provide for the number of terminals to 'be supported and response 
times to be maintained. The model is de:.cribed and additional observational data 
is cited to support the model's assumptions about characteristics of students' 
terminal behaviors, 

MODELE D'UN SYSTEME CENTRALISE D'ENSEIGNE^^ENT A L'AIDE DE L'ORDINATEUR 

^ Cette communication est en soi un rapport preliminaire sur un syst^me 

d instruction ^ I'aide d'un ordinateur et comportant des etudiants loin de I'ordinateur 
mais relids ^ lui par une voie commune d'echange de donnees. L' analyse du syst^me 
est base sur un module de 1' ensemble mis au point parl'IORE et ie CNRC. Le module 
implique I'etude des conditions imposees de .liaison pour que I'on, dispose du nombre de 
terminaux necessaire et du temps de r^ponse^*'^ etre conserve- Nous' decrivons le module ' 



et nous citons 



des donnees supplementaires* d 'observation pour eta^ 

faites pour etablir le module et conceYnant le comportement des etudiants aux terminaux 



tayer les hypotheses 
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6 



The National Research Council (NRC) and The Ontario Institute for 
Studies in Education (OISE) have developed jointly a computer-assisted 
instruction (CAI) system for rersear^ purposes. NRC provides the 
central computing facilities ;tor carrying out CAI research while OISE 
provides the curriculum to b0 used/ on that facility. OISE is respon- 
sible for the data communications' for the project. This paper examines 
the data communications for that' system. 

The hardware system is shown schematically in figure 1. student 
terminals, typically of the model 33 teletype variety, are connected 
to a small computer located r.t OISE. This computer performs a line 
concentration function enabling all of the student terminal information 
to be transmitted over one data communication line to the NRC computer 
in Ottawa. At NRC, a general purpose time-sharing computer executes 
the CAI program. Output to the student is then returned along the data 
communications line to the line concentrator which directs it to the 
-appropriate student terminal. 

The central computer facility is a general purpose time-sharing computer 
which is used b^ other educational institutions for research in instruc- 
tion. Thus the other lines running into the NRC computer represent 
additional computing requirements simultaneously with the use from OISE. 
It should be noted that some of these other users aire also using the 
CAI system developed by OISE. 

The CAI system is built around ap interpreter for the CAN (Churchill, 
et al, 1970) CAI language. The interpreter currently is written in 
FORTRAN and contains additional assembly language communication routines 
to deal with the line concentrator. 

The CAN interpreter is run as an individual job on the NRC computer. 
It provides the CAI function for as many terminals as can be concen- 
trated onto the data line. Alternatively, it can be used at a single 
terminal without a concentrator by any time-sharing user. Several 
copies of the interpreter may be in use at the same time. 

leased telephone line 
>J200 baud, full duplex . 



3 

NRC 

COMPUTER 
(PDP-10) 






MODEM 






OISE 
LINE 
CONCEN- 
TRATOR 
(TSS/8) 



ii 



to 
student 
terminals 
(most 
pn 
njo^ems) 



Figure 1. NRC~0I3E CAI System 
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1. Think and Reply 



ra. Think Time 
^ b* Reply length \ 
c. Typing speed ^ 



strate< 



4. Data Communications 2. Data Communications 

a- Channel speed o a. channel speed 

b. Error characteristics b- Error characteristics 

c» Terminal speed . 
d* Output strategy 3. Central CAI Processor J 

a. Processing, time ^ 

b. Scheduling latency 
v c. Computing load 

Figui^e 2. The CAI message cycle 

The CAN system is now operatjLonal\ It provides a research facility 
for the testing ^nd evaluation of CAI curricula in remedial mathematics 
- for up to 10 students simultaneously. The design choices that have 
been made for this system represent one of many possibilities, however, 
and it was considered that a model of this type of processor organiza- 
tion might indicate the feasibility of similar designs using a variety 
of communications equipment. 

The Model's Structure 

The mod^l is composed of four major components. T^es^Tiiay be viewed 
as a circle of events as indicated in figure 2. Th^ Aodel/naintains 
the steady-state performance of N of these cycles r^piiea^ting the N 
students who are using the system at a given time. Hefice, the number 
of students using the system is one of the major parame^rs deter.nining 
the behavior of the system. Additional parametersyWirich govern system 
behavior are indicated in figure 2 opposite the p^^rtion of the model 
that they influence. 
\ 

The .cycle is initiated following the termination of output to the 
student from step four. Student behavior consists of 1) an amount of 
time required to think about the output from the computer and to conr 
struct a Beply, 2) the length of the reply that the student constructs/ 
and 3) the typing speed with which he can enter the response on his 
terminal. 

The second phase in the cycle begins with the student's response as 
entered into the line concentrator. Identifying informatiori and message, 
protocol information must be added to the message and this is denoted 
as message overhead. The speed with which messages are transmitted to 
the central computer and the error characteristics of the data channel 
determine^the time required to transmit the student's response to the 
computer. Message queuing within tfte line concentrator is on a first 



in, first out basis under all conditions. 

Once the message has arrived at the central processor, four parameters 
govern the length of time of the interactic.i. These are •:he availabil-- 
ity of the central processor, the length of processing tiin<^ to produce 
a response, the length of that response, and the amount of time that 
a given job can spend executing within the ^time-sharing computer, the 
scheduling latency and slice time parameters are functions' of the time- 
sharing monitor's queue discipline and of the amount of computing activ- 
ity at any given instance ♦ 
* 

The response length is primarily a function of the curriculum itself/*' 
The length of processing required for a given interaction with a student 
IS a functior * oth of the curriculum and ^bie, interpreter that executes 
that curriculum. / ,\ 

The transmission to the student is^fJrinfarily a ^function -of the channel 
speed between the central compiler and the line concentrator and the 
speed of the student's terminal.- The order of transmission becomes 
important when several student terminals are active simultaneously. 
Finally, the proportion of the response that must be received at the 
concentrator before output to the student ^commences may also impose 
a delay on the data communications. The latter might be necessary, if 
error correcting procedures .were to be used at the line concentrator. 

Following the fourth step (the transmission- of in#Drmation to the 
student) , the cycle commencies again at step one with the student think- 
ing and repl^ring. 



Output Data from the Model 

The model produces statistics concerning each of the- four phases in 
the cycle • For- student behavior it produces summaries of the amount 
of time spent in each of four postulated student activities—thinking, 
responding, waiting for output and reading the output. These statis- 
tics are primarily confirmatory at present, but could be used to study 
the system effects on student behavior. 

Statistics about the second phase, .queuing of transmission to the ^ 
computer, concerns the length of queues associated with input to the 
computer and the buffer requirements'' within the line concentrator. 

Data produced regarding tha computer processing phase indicates the 
general load on the time-shaiing system, the^- storage requirement and 
the length of input and/or output queries developed during a run. This 
information can then be used to estimate the load upon the central 
processor. 
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The final portion of data lirovided by the model concerns the transmisX 
sion of information to the student. This is the portion of the data 
communication system 'that is most heavily loaded, it also represents 
a decrease in data transmission speed as the message approaches the 
student and, hence, a requirement for buffering at the line concentra- 
tor. .This data is the most relevant indicator of the performance of 
• the_ system as a whole. The data derive'd at this point include 1) the 
maScimum and average delay from the end of an input message to the" first 
character of optput on the user terminal; 2) the number of instances of 
interruption of output due to nonravailability of the remainder of the 
output; 3) the maximum buffer size required by each terminal; '4) the 
maximum buffer size required for all of the terminals over the time of 
the run and 5) the maximum length of queue on outp*ut. ' 

The modeL-«.as simulated iiv FORTRAN, in addition to more general queui-ng 
analyses. The remainder of this paper will be devoted to the presen- 
tation of 'representative results. The basic question of interest at 
present concerns the number of students that can te serviced by various 
-configurations of terminal speed and concentrator data line speed. For 
instance, how many student terminals can reasonably be connected to the 
system as it exists now. That is, given terminals of the KSR 33 tele- 
type class and a data channel of 1200 baud rate, how many students can 
use the system? 



Assumptions 

In order to explore the behavior of this CAI system it is necessary to 
have data regarding the behavior of several components of the system, 
including student behavior at the terminal, amount of processor time 
required perj.nteracti6n, characteristics of the curriculum, etc. If 
data are not availsbieT— reasonable assumptions must be made until more 
adequate observations can be obtained. The latter is the case to a 
great extent in the rresent situation. We 'are beginning to get"reai 
data about system performance, but they are not yet entirely adequate. 
The present discussion will therefore require a mixture of assxamptions 
tempered, where possible, with <feta derived from actual use of the 
system. 

Student response times are assumed to be distributed exponentially 
following the conclusion of output from the computer, with a mean re- 
sponse time of 30 seconds. The selection of this time represents a 
compromise between observation and guess. Observations' of students now 
using the remedial mathematics curriculum indicate that the mean is more 
nearly-*60 seconds, which seems inordinately long for interactive CAI. 
The difference^ is due to. the particular curriculum-student combination; 
the mathematics lends itself to long periods of calculation between 
question andcanswer. Calculations .based- upon the mean of 30 wui. 



presumably, err on the side of safety and give ample room for future 
alterations of the curriculum that yield shorter, interaction intervals. 



Some support comes from the extensive Plato data ^Bitzer and Skaperdas, 
1970) which show an average of one student request every 2 to 4 seconds. 
A "request" is a character; when aggregating characters ijito 5 to 15 
character responses typical of this curriculum the 30 second average is 
in the same range. 

Computing time is assumed to be exponentially distributed with a mean 
of 250 msec. To this is added a constant of 200 msec. Timing experi- 
ments with portions of the mathematics curriculxini have demonstrated 
that this is approximately correct for the current CAN interpreter . 
This processor overhead is exorbitant due to its being written in 
FORTRAN; it is estimated that the CPU cost of interpretation of CAN 
can be decreased by a factor of 5 to 10 by a more efficiently coded 
interpreter. The present report must be regarded as applying to the 
research and developanent tool currently in use; the processor utili- 
zation figures could be divided by at least 5 for any production imple- 
mentation. This improvement would shorten the response time predicted 
for the present system. 

For purposes of the model, the output messages to the student are assumed 
to be a mixture of instruction and problems. The former are assumed to 
be about 5 lines long and the problems, 1 line long. A line averages 
50 <:haracters in length. The mixture is 80% problems, 20% instruction. 

The data comntunications assumptions of the model include the use of 
standard teletype terminals cuid an inter-computer data link operating at 
1200 baud. Other speeds of terminals and link are also explored. 



Table 1 gives the delay in seconds between the student's carraaga return 
and the first character of the con^uter's reply, in terms of average 
delay and the longest delay encompassing 90%^and 95% of the cases. The 
figures given are for the teletype^erminals with up to 32 students on . 



that these figiares do not include a delay due to .queuing for execution 
at the CPU in competition with other time-sharing jobs. This is a real 
concern, of course, but this delay is not presently included. Any queu- 
ing resulting from this job is included/ however.- 

Simulation results for up to 32 terminals are given. Assuming that a 
2-second response time .is acceptable, the experimental system is capable 
of providing for the 32 terminals^ although better service would be 
obtained at higher speeds. 



Results 



a 1200, 1800, and 2400 




It should be noted 
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TABLE 1: Simulated delays in seconds between 
student response and computer output 



110 Baud 




1200 Baud 




1800 Baud 




2400 Baud • 


.Terminals 


Avg. 


90% 


95% 


Avg 


90% 


95% 


Avg. 






2 


1.02 


1.31 


1.46 


.83 


1.08 


1.26 


.74 


1.04 


1.22 


8 


1.04 


1.48 


1.65 


.85 


1.21 


1.35 


.75 


1.12 


1.29 


14 


1.08 


1.59 


1.82 


.84 


1.25 


1.44 


.72 


1.06, 


1.27 


20 


1.08 


1.60 


1.81 • 


v83 


1.26 


1.47 


.76 


1.18 


1.44 


26 


1.09 


1.60 


1.82 


.84 


1.30 


1.52 


.75 


1.18 


1.39 


32 


1.15 


1.75 


2.02 


.86 


•1.33 


1.54 


.76 


1.22. 


i.46 


300 Baud 




















Terminals 




















2 


1.01 


1.34 


1.51 


.81 


1.16 


1.30 


.73 


1.02 


1.18 


8 


1.02 


1.42 


1.55 


.83 


1.18 


1.34 


.74 


1.06 


1.20 


14 


1.04 


1.47 


1.72 


• 84 


1.25 


1.46 


.74 


1.10 


1.32 


20 


1.11 


1.63 


1.92^ \ 


.87 


^ 1.35 ' 


1.56 


.75^^ 


1.13 


1.36 


26 


1.11 


1.68 


1.94 


.86 


1.31 


1.55 


.77 


1.22 


1.45 


32 


1.19 


1.89 


2.15 


.88 


1.39 


1.61 


.78 


1.28 


1.52 



Given the average message length and number of messages per hour, the 
result is about 100 characters per minute per terminal. A 1200 baud 
line is capable of 7200 characters per minute. Thus for 32 terminals" 
the output portion of the line has an average line utilization of 44% 
Frcm queuing theory, we can expect transmission times, which include 
queuing to average between 1.4 and 1.8^ times the actual transmission 
time. The 44% utilization is considerably below the critical 70 to 80% 
point at which queues grow very rapidly; thus it offers a considerable 
margin of safety. (Martin, 1972) 

Alterations of the terminal configuration have the predictable conse- 
quences: using ."^C character per second terminals results in increasing 
the rate of interaction by about 6 to 10%* This is a result of the 
assumption that students do not process the question or instruction 
until it has entirely arrived at the terminal; to some extent this is 
probably true and the higher speed terminals may speed the rate or 
instruction. Beyond that, at 30 cps we find instances of interruption 
of output to a terminal because the next line of information has not 
arrived at the concentrator when the terminal's buffer is empty. For 
the 1200 baud system, the interruptions occur in 3%' of the messages for 
14 terminals. They increase to 14% of the messages for 32 terminals. 
The average duration of interruption ranges from 0.1 second for 14 ter- 
minals to 0*5 second for 32. These interruptions disappear with a 2400 
baud line. 
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Conclusion 



Preliminary analyses of the data conmunications behavior of a medi n 
scale CAT system based on a remote concentrator and use of a time-shared 
computer facility 5=!iOWS that the concept is feasible for up to 32 low 
speed terminals operating on a voice-grade data connection. The simu- 
lation and other analyses omit the factor of general loading of the 
jtime-sharing system f which oould become critical to the maintenance of 
response t^me. The present interpreter places sevejre computing demands 
upon the timesharing system — up to 30% utilization for 32 terminals; 
this is a result of inefficiencies tolerated in a processor for research 
and development purposes. This should be reducible "to a load of 3 to 
6% in a production system. 
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INSTRUCTIONAL APPLICATIONS OF THE COMPUTER AT THK UNIVERSITY OF LOUV^AIN SESSION 3 
By /Par: A. Jones, ROOM/SALLE 
Universite Catholique de Louvain, ^ 148 

Belgium. 

The utilization of the computer in education sets up an important pi'oblem: 
All media used in education are, in principle, good. But then, what is 
the right place of the computer in this panel? 
\ Tfiere~are many ways to use the computer: 

- tp te&ch 

- to evaluate 

- to^^aid. 
To teach: 

The computo.r may be used in the following modes: 

- giving basic informations: we have some critics about this way of use. 

- Simulation: to do this, the computer is a very useful- mean. 
But we need another mean to give the basic informations. Good 

^ simulation asks for imaginative work. ^ 

- Heuristic research: but this supposes basic informations given by 
other means. 

- Questions and answers: Information being given, the computer is used to 
correct wrong assimilation of concepts. 

To evaluate: 

Evaluation belpn^js to student and to content. This supposes that we have 
defined the goals oif our teaching on different' aspects . What actually exists is of 
no great utility ^or evaluation by computer. Evaluation of students calls for adaptative 
content and "Human Operator" model. 

To aid: <is a calculation device. 

LES APPLICATIONS DE L'ORDINATEUR X L'ENSEIGNEMENT A 
P"llNIVERSIT£ DE L OUVAIN 

L' utilisation de I'ordinateur dans I'enseignement pose un probl^me important: 
< - Tous les moyens d* expression utilises dans I'enseignement £::,»c, en" 

principe, bons. Mais alors, ott doit se situer I'ordinateur dans ce cadre? 
II y a bien des mani^res d'utiliser I'ordinateur : 

pour enseigner 

- pour evaluer 

- pour aider 

Pour enseigner: \ 
On peut se servir de lo* ordiiiateur pour: 

- donner des renseigndments fondamentaux; cette fa^on d'utiliser I'ordinateur 
peut se preter ^ quelques critiques. 

- simuler. i/^ordinateur est un moyen tr&s i*tile mais il faut un autre 
moyen pour donner les renseignements fondanentaux. Une bonne simulation 
exige un travail d' imagination. 

- faire des recherches heurlstiqufs mais ceci suppose des renseignements 
fondamentaux foumis par d'autres moyens. 

- poser dos questions et avoir les reponses. Les renseignements etant 
donnes, on utilise I'ordinateur pour corriger une mauvaisc comprehension. 

Pour evaluer: 

L' evaluation appartient \ I'etudiant et au -contenu. Ceci suppose que nous 
avons dSfini les objcctifs de notre enseignoment sous ses differents aspects. Ce qui 
existe actuellement r/est pas d'une grande utilite pour I'evaluation par I'ordinateur. 
L Evaluation des etudiants implique une souplesse d' adaptation de la machine qui doit 
obSir % un module d* ''operateur b*»main". (, 

Pour aidet': comme caiculateur. • 
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COMPUTER ASSISTED INSTRUCTION ON A SMALL COMPUTER SESSION 5A 

By /Par: Ann Brebner, H.J. Hallworth, ROOM/SALLE 1A3 

University of Calgary. . , 

The CAT project in the Faculty of Education at the University of Calgary 
has been primarily concerned with the use of a small time .shared computer. 

Seven terminals are in use in the Universaty, and nine are currently located 
in schools and a research institute for the developraen tally handicapped. 

The paper describes the development of simulations, computer assisted 
instruction and computer managed instruction programs. A CAI language and an information 
system have been written for the time shared machine, and are discussed. 

Most programs have been developed for use at school level. They relate, for 
example, to elementary arithmetic, English, social s^ddies, mathematics, physics and, 
counselling. Particular attention is now being given'^to programs for the handicapped. 

Experience, in the^use of this machine indicates certain advantr.ges «r.d 
limitations of a small computer. It is comparatively inexpensive to brine such a system 
into operation and develop a variety of prograirs. However, the difficulty of maintaining 
a number of programs in constant use indicates the need for access to a larger machine 
and a more versatile CAI language. 

Particular attention is drawn to the need for terminals specifically designed 
for CAI, and thJ^ need to obtain some compatibility o,f both hardware and software within 
Canada in order to facilitate co-operation in the development and use of instructional 
programs, 

L'ENSEIGNEMENT A L^AIDE D'ORDINAT^RS SUR UN PETIT ORDINATEUR 

/ 

^ ^ Dans I'etude EAO S la faculte'd'education de I'Universite de Calgary, on 

s est interesse surtout S I'utilisatioh d'un petit ordinateur S temps partage. 

A I'Universite, on se sert de sept terminaux et, actuellement, il en existe 
neuf dans les ecoles et dans un institut pour les handicapes, 

-J Dans cette communication, nous decrivons le d^veloppement de simulations, 

1 enseignement S I'aide d' ordinateurs et les programmes d' enseignemenr diriges par 
crdinateurs. Un langage EAO.et un systeme d' informations ont ete ecrits pour la 
machine \ temps partage et nous en discutons. 

La plupart des programmes sont congus pour etri utilises dans les ecoles. 
lis se rapportent, par exemnle, S I'arithmetique elementaire, ^ 1' anglais, aux etudes 
sociales,^aux mathematiqnes , ^ la physique *»t S 1 ' orientation, present, on etudie 
particulierement des programmes pour les handicapes. 

L'experience de 1 ' utilisation de cette "machine demontrc des avantages et 
des limitations d'un petit ordinateur. II est relativement peu couteux de meture ce 
systeme en operation et de developper des programmes differents. Cependant, 11 ej^t 
difficile de faire marcher plusieurs programmes qui sont constamment en usage et nous 
constatons qu'il e§t necessaire de se servir d'une plus grande machine et d'un 
langage EAO mieux adapte. 

^Nous attirons 1' attention sur le besoin de terminaux con^us specialement 
pour EAO et sur la necessite d'une compntibil ite cntrc T ordinateur et la progrnmmation 
dans notre pays afin de faciliter la cooperation en cc qui concerne le devcl oppt'incint 
et 1 ' utilis.-^tion de programmes pedngogiques . 



/ 
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The computer assisted instruction project in the Faculty of 
Education at the University of Calgary has been centred round a 
small time-shared computer, namely a Digital Equipment Corporation 
TSS-8 system. - \ 

More specifically the present hardware configuration consists of 
a PDP-8/I computer with a 12 bit word Irr.^th, a time-sharing option 
(KT8/I),and an extended arithmetic option (KES/I) . There are 16K 
words of core s,tore; a 256K word disk (RS08) and disk control unit 
(RF08) ; six DEGtape units (TU55) and a DECtape control unit (TCOl) ; 
and sixteen PT08 terminal interfaces, ten with F options to allow 
attachment? to a phone line. 

The system supports seventeen terminals. Seven of these are in 
the University and are hard-wired to the computer. Four are in a 
trailer and are attached to the computer by means of a multiplexer 
and two phone lines. The ^remaining terminals are located in schools 
and in a research institute for th^ developmental ly handicapped. ^ - 
These communicate with the computer through acoustic couplers and the ^ 
ordinary city telephone network, and share the remaining available 
ports. This latter method is the most flexible means of communication, 
as by simply dialling another appropriate phone number the terminals 
can be attached to a different computer such as the CDC 6400 in the 
University Data Centre or the PDF 10 at the National Research Council 
in Ottawa. 

Four of the terminals in the University and four terminals in the 
trailer are mounted on computer assisted instruction stations. Each 
of these is eqiipped with a teletype, a random access slide projector 
and a rear view screen. Output from the computer to a CAI station 
passes^ through a special interf acel Normally information passes 
straight through to the teletype, but when a specific non-printing 
character is received by the interface, the following character is 
routed to the slide projector. Therefore, at these stations, material' 
can be presentled botlV on slides and on the terminal printer. 

The software for this interface has been written in such a way that 
ijt is extremely easy for the programmer tp use. He merely has to call 
a function, the argument* of which is the number of the slide to be 
displayed. This slide remains on the screen tintil the function is 
called again ^th a different argument. 
/ 
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The high level languages supplied with the TSS-8 system are 
FOCAL, BASIC, and a version of FORTRAN; there is also an assembler 
langucxge, PALD, and a set of utility programs to manipulate and 
transfer files between the disk and other peripheral devices. 
There is no CAI author language implemented on the system and 
consequently most CAI programs have been written in either FOCAL 
or BASIC. A special purpose CAI language, SCROLL, has been 
developed and is used for some programs. 

' Many students in the Faculty of Education presently learn to use 
the system. Courses on the use of computers in educati \re run 
both at the undergraduate and graduate level. In these, scudents 
are first taught a computer language and then how to write computer 
assisted instruction programs. Those who are teachers, and those 
who are engaged in practice teaching, are encouraged to take 
terminals into their schools and make use of the programs they have 
written. 

Students in an intermediate statistics course use the terminals in 
two ways. Firstly they have available a set of statistical programs 
into which they can put their own data to obtain histograms and 
descriptive statistics, means, standard deviations, correlation 
coefficients, t-tests, chi-square tests, and one and two way 'analysis 
of variance. Secondly, they learn ^t'.e elementary concepts of tha 
FOCAL language and write their own programs for statistical tech- 
niques v/hich are not available in the above package. 

The terminals have been used -'uring the current session to assist 
with the teaching of the elementary statistics sr^.ction of o/ie of the 
large introductory classes. . This experiment took the form of a set^ 
of eight CAI programs and a- self-evaluation test written in the BASIC 
language for use at the CAI stations. The programs were essentially 
user controlled^ in tha*- the student could work through them in any 
order (although there was a suggested path). He could also work 
through any program as many times as he wished, and coulJ take the 
self-evaluation test at any time. His answer was not always checked 
by the computer. Frequently he was asked to v;rite down his answer, 
and check it against the correct answer printed on request by the 
terminal. » This amount of user control appeared to work well at under- 
graduate level with a student group having widely diverse statistical 
backgrounds. ^ ' - 
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Terminals linked into the TSS-8 system have beea placed in schools 
for the last three years and the majority of CAI programs written 
have been for use in schools. These range from drill and practice 
programs for elementary grades to calculus and physics program-, for 
grades 11 and 12. 

By far the largest group of programs are those for drill and 
practice in elementary arithmetic, which require only a teletype 
terminal. There are presently some sixty programs in this area. 
They g/.ve practice, at various levels of difficulty, in counting, 
basic number facts, place value and addition. Recently, several 
programs in fractions and problem solving hav^ been developed- All 
programs are constantly being revised and rewritten in consultation 
with the staff of schools where they are in regular use. 

A set of programs- on addition and place value was designed 
specifically for use with the iPI (Individually Prescribed In- 
struction) project which is currentl; in operation in a Calgary 
eleni,entary school. A management system was also developed for use 
in conjunction with this project. This^is currently bein re-written 
in a more general form in order that it may be Used Ky a greater 
number of schools. 



A set of drill and practice programs in English is under develop- 
ment, concerned with noun and verb agreement • ' 

For two years the trailer has been located at a combined high and 
junior high school* The terminals are used regularly by students of 
math option clc ^es who learn to program in jthe . FOCAL language. CAI 
programs written for schools which require the slide projectors are 
also run in the trailer These include a calculus program in which 
it is necessary to display graphs oi functions; programs on problem 
solving in physics where diagrams and equations are shown on slides; 
a CAI program on map reading; and a program on vocational counselling. 
In this latter program the slides are used to display to the student 
first a list of interests, then a list of aspired educational levels. 
The student chooses one from each list and is presented with a match- 
ing list of occupations, again on a slide. He may then choose one or 
mo. of these and details of the job are printed out on the teletype. 
No attempt is made to match his choices with his present achievements 
.except to list for him the further courses and grades he needs in 
order to prepare himself for the chosen job. 



Other programs which are occasionally run-in schools are simu- 
lations and games. Among this group the more educational programs 
are on elementary economics, fur trading in (Quebec in the 1760 's, 
farming in Kansas in 1880, and ranching in Alberta. The objective 
in all these is essentially the same, to keep the enterprise 
running from year to year. Other programs simulate biological 
systems, for example an aquarium, or experiments in physics." Most 
of the latter have been developed in co-operation with Dr» C. Anger 
of the Physics Department, and are now being implemented ott a CRT 
terminal with simple graphics. 

More recently, CAI programs have been written for use in an 
institute for the developmentally handicapped. Much of the in-- 
struction carried out in such an institute is necessarily done on 
an individualized basis due to the widely varying abilities of th'e 
trainees / Some of the drill and practice programs written for use 
"in the elementary schools can equally well be used here; other 
programs are those concerned with everyday living. The latter in- 
clude coin recognition, coin equivalences, making change and 
budgeting. There is also ^ set of pro^^rams designed to help 
trainees recognise the tools used in job training courses • 

When the slide projectors were successfully interfaced to the 
computer, a whole new range of possibilities for CAI programs 
opened up. For example, until this time it had been difficult to 
produce many progratns for mathematics because it is not possible 
to prest^nt algebraic equations in the -correct form on a teletype. 
Programs also became feasible on such topics as the recognition of 
alpine flowers or constellations of stars. 

Further technical developments in terminals for CAI work again 
greatly widen the scope of effective programs which can be written • 
These include the ability. to play computer controlled audio 
me:;sages and to accept input to the program through the NRC touch 
sensitive display. Such terminals- may be used for Spelling pro- 
grams, for example, and by that group of students who canpot read 
a written message or type a r^i-ply on the keyboard. ' 

It therefore appears that there is' a need for a complete range 
of terminals, from the simplest type with printer and keyboard for 
the teaching of programming, to the more complex type for the 
running of CAI programs. 



More important, however, is the need for compatibility of codes, 
particularly the non-printing control codes, in oLder that programs 
can be readily transferred between terminals. For CRT type 
terminals, and for terminals attached to a small computer, there is , 
also a need for some sort of local storage facility. 

The greatest- disadvantage of running a CAI project on a small 
stand-alone time-shared computer is the lack of sufficient storage 
space for' programs" ana data. The point is rapidly reached where 
there is need* fi c tight ^chediiling of programs stored on the disk - 
and much. time is ^pent transferring programs between the disk and'^ 
other peripheral storage devices. Another disadvantage is thj^t the 
number of terminals which can be attached simultaneously to the 
system is relatively small: the seventeen terminals attached to the 
system described above is the maximum number -for this configuration. 
The fact that there is no CAI language as such has not proved a 
gerious disadvantage. With a little, ingenuity on the part of the 
programmer, effective CAI programs can be written in BASIC and to a 
limited extent in TOCAL. This does, however, mean that the develop- 
ment of> CAI requires a relatively skilled programmer. 

An important advantage of the small computer is that it can be 
dedicated entirely to CAI work. Also, a small machine is Relatively 
inexpensive and can be built up- gradually , starting if necessary with 
the basic computer, 4K of core and one teletype. It is therefore a 
viable system for a school board or group of schools.^ 

s 

Of the programs yhlch-have so far been developed, simulations 
make good use of the computer, are popular with the students and 
could be used to teach a substantial part of the curriculum. For 
example, the simulation of the various aspects of the operation of 
a company has a useful place in a business education course, and could 
possibly be made the basis for such a course. Simulations can also 
play a major part in a physics or chemistry curriculum. Drill and 
practice programs are easily written, but there is need for careful 
sequencing of the programs and for different levels o£ difficulty 
for each topic. They should be organized so that any one in tie set 
is easily called into use by the teacher ancf, if pns§^ble, they 
should include some automatic logging of the students* performance. 
Similarly, any management system must be very easy for the teacher 
to- use: it must aim to reduce the teacher's routine work and allow 
him time to help students with ^^roblems which cannot be resolved by 
a CAI program. * 



^ Large branching types of tutorial programs are not practicable 
oi^ a small computer. However, limited programs of rhls type cah 
be written if there are terminals on the system which can present 
material on slides or audio tapes. 

The areas to which CAI can be best applied at the present time, 
and in the immediate future, are those in which the ratio of 
students to tec:,har is small. These are the areas in which CAI 
ic already becoming an economic proposition. They include remedial * 
vork/ counselling, and instruction in institutes for the develop- 
mentally handicapped. 

It is considered that the programs described in this paper have 
demonstrated the practicability of computer assisted instruction 
on a small machine,^ As the point is preached where larger sets of 
programs are being produced, sufficient to cover a greater part of 
the curriculum, there is need for a careful and critical evaluation 
of the educational value of different types of programs. Also, as 
we approach the stage at which programs are written which will be of 
considerable relevance in the school classrooxr. and at university 
level, there is a large task ahead in^prbducing the appropriate 
educational mat^irials* ^ 

It is apparent that other groups" in Canada will be engaged in a 
similar task. It is equally apparent that increasing co-operation 
would to the advantage of all. • ' _ ' ■ 

The first steps in this diractlon require the development of / 
compatible hardware and software and, insofar as possible, acces^ 
to a large central computer on which -programs can be tried and 
exchanged. 

These are the objectives of the N.R.Q. computer-assisted instruc- 
tion project v?hich is described in the following paper. 

' 1 
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In 1967, the National Research Council began a preliminary study of the 
application of computet£> as aids to learning. This initial work led to the establishment 
of a central rese,irch facility which is used by NRC and a number of educational research 
organizations in a cooperative programme of research into Computer Aided Learning. 
This central facility includes a medium scale time-sharing computer wh'ich is accessible 
to the participating organizations by means of remote terminals. j 

A major objective of the .project is to provide a facility which will allow 
the active cooperation of research workers throughout Canada in the development and 
evaluation of Computer Aided Learning systems to meet Canadian requirements. The NRC 
efforts are concentrated in the areas of development of terminal equipment specialized 
computer facilities, and systen programmes. Examples of such development include audio 
tape and disc -storage units, a transparent touch sensitive tablet for computer input, 
alphanumeric: aad graphic display devices, line concentrator systems and supporting 
system programmes. The cooperating educational organizations provide the facilities 
for the development and testing of course naterial and evaluation of terminal equipment 
and in some cases, assistance in the development of system programmes. 

The fi,rst participating educa^ >hal organization to go "on line" was the 
Ontario Institute for Studies in Educotioi; in Toronto which was linked "to the computer 
early in 1970. Since that'time^ the number of on line participants has grown to five. 

The project provides a means for close communication between the' educational 
researcher and the system designer. In this woy, effective use can be made of available 
resources to arrive at a system specification which more closely meets the requirement 
of the user -than might otherwise be possible. 

LES RECHERCHES FAITES EN COLUBORATION AVEC LE CNRC 

.En 1967, le Conseil national de recherches a entrepris une etude preliminaire 
sur I'application des ordinateurs pour faciliter I'enseignement. Ces premiers travaux ' 
ont conduit S I'etablissement d'une installation centrale de recherche qui est utilisee 
par le CNRC et d'autres organismes de recherches pedagogiques dans le cadre d'un programme 
cooperatif de recherches sur I'enseignement 21,1'aide d'ordinateurs . Cette installation 
centrale comprend un ordinateur ^ temps partage de taille moyenne qui est accessible aux 
organismes participants au moyen de terminaux eloignes. 

Un- des principaux objectifs de I'etude est de fournir une installation qui 
permettra la cooperation active des chercheurs dans tout le Canada pour developper et 
evaluer des syst^mes d'enseignement h I'aide d'ordinateurs satisfaisant les conditions 
canadiennes. Les efforts de CNRC portent surtout sur les domaines du developpement 
d equipements terminaux, d'equipements specialises et de programmes de syst^mes. Voici 
quelques exemples de ce developpement: des memoires audiophoniques , sous forme de bandes 
magnetiques et de disques, un ecran d'entiree sensible et transparent, des dispositifs 
d'affichage graphiques et alphanumeriques , des syst^mes de concentration des 3 ignes de 
communication et des programmes appropries. Les organismes pedagogiques cooperants 
fournissent les installations pour developper et essayer le contenu des cours et pour 
evaluer I'equipement des terminaux et, dans certains cas, ils aidcnt S developper les 
programmes adaptes 2l des systfemes particuliers. 

^ Le premier organisme pedagogique participant, a ecre en liaison directe, est 

1 Institut ontarien de recherche en education ^ Toronto qui a etc relie ^ 1 'ordinateur 
d^s 1970. Depuis cette epoque, le nombre de participants en liaison directe est monte ^ 
cinq. 

L etude donne un moyen de communication rapprochee entre le chercheur 
pedagogique et I'ingenieur ayant congu le syst^me. De cette fagon, on peut utiliser les 
ressources -disponibles d'une mani&re efficace pour arriver 2l des notr^es qui satisfont 
mieux les besoins de I'utilisateur. 
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In 1967^ the National Research Council began a 
preliminary study of the application of computers as aids 
to learning. It was immediately apparent that effective ' 
work in this field could not be carried out without the 
actiyb cooperation of the educator. Thus very early in the 
project^ contact was established with the University of 
Calgary and the Ontario Institute for Studies in Education 
in Toronto. Both of these organizations have been actively 
participating in the project since its early stages and 
-have significantly affected the direction which it has 
taken . 

_ The N.R^C. program is aimed at the development of 

f acirities necessary to permit the computer to be used 
effectively by student^ teacher^ and researcher for conver-r 
sational tutorial interchange^ df ill .an^ practice^ enquiry 
operations for information, r^trie^^al from libraries and 
data ;bahks as well as the' entensive computational operations 
normally associated with the computer. Additionally^ and 
perhaps most important is the. use of the computer to 
simulate experiments which might- be top lengthy, costly or 
dangerous to be carried out in the laboratory^ or to 
simulate situations which result in the student experiencing 
responsibility through realistic decision making. 

Acceptance of computer aided learning by students, 
teachers and others will be dependent on the availability of 
a wide choice of fully evaluated courses, the adequacy of 
the terminal and system facilities for the presentation of 
subject matter and acceptance of user input, and the degree 
of equipment and communication standardization which can 
be achieved in the interest of cost reduction. The terminal 
and system facilities must provide the user, be he student, 
teacher or researcher with full access to the power 
available to him in the computer. Well defined measures of 
the benefits to be gained from computer aided learning must 
be available to the educational administrator to permit him 
to weigh the advantages and costs involved in order to 
decide when, where, and how to implement CAL syrtems. 

To provide a means whereby effective use could be 
made of available resources in the research and development 
effort required to arrive at an acceptable computer aided 
learning system, the National Research Council established 
a central research facility aimed at catalysing a national 
effort in this field. To encourage the free exchange of 
techniques, course materials, and evaluated results 
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necessary to achieve the required degree of standardization, 
N.R.Ci services ih systems prografnming , special equipment 
design) ahd computer time are of fered. without charge to 
coj.laborating groups undertaking research projects to 
.further the overall aims of the program. N.R.C. undertakes 
no curriculum development; this, is contributed by the 
educational research groups engaged with us in this program. 

Some of the advantages offered by the centralized 
research facility include: 

- Orderly evolvement of necessary standards 

- Possibility for immediate, exchange of programmes 
and course materiais at the research stage 
t.hrpjagh the "electrohic. publicatibn" fa~ciiities 
of the .c6nip,ute'r j — ■ 

- •Availability of a ^system for support of special- 
ized author languages and testing of experimental 
features by the participatihg 'organizations in a 

• ' wide range of applications. 

The provision of adequate facilities to permit 
interested groups to undertake research in common with the 
goal of defining system requirements is one of the main 
objectives of the N.R^C. program. Thus the design and 
technical evaluation of specialized computer terminal 
equipment and system programmes to permit its use in a 
flexible manner are features of thel development work under- 
way m the laboratories? of the. Information Science Section. 

Work in the area of student terminal development 
IS concentrated on input, storage and display .aspects and 
on the development of the software required tQ make 
effective use of the features incorporated in these 
specialized terminals through the central computer facility; 
These efforts are aimed at the development of terminal 
facilities which are not currently available and at their 
integration with equipment which is available. A major 
emphasis is placed on conformity to applicable standards. 
Some examples of the work on specialized facilities for- CAL 
terminals include the following: 

- A transparent touch sensitive input tablet 

has been developed which will transmit data to the computer 
when the surface of the tablet is touched. This device 
uses ultrasonic surface waves on glass,, transmitted 
sequentially from two adjacent edges, to determine the 
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position of the finger or other passive stylus such as a 
pencil. The tablet is being produced commercially under 
license from N.R.C. 

. - Methods of character generation are being 
investigated giving due regard to the requirements of 
displaying, text,, in both English and French, of sufficiently 
high quality that there is no eyestrain. Methods are also 
being .investigated for the storage and display of graphical 
information, both line drawings and T.V. still pictures 
with grey scale in conjunction with alphanumeric displays. 

- To permit the presentation of audio information, 
experimental equipment has been developed which permits the 
computer to select pre-recorded messages from a conventional 
audio tape recorder. An "instantaneous response" audio 
unit Is currently under development which will eliminate 
many of the jproblems in tape storage of^ information, notably 
the long, delays which are sometimes encountered in retriev- 
ing a desired message. 

Special purpose components such as the above have 
been assembled with a conventional keyboard-printer computer 
terminal and the necessary communications interface designed 
to permit operation of this multi-media student terminal 
from the central computer through a conventional telephone 
connection. 

With the aim of achieving more economical access 
to the computer, programmes have been developed for small 
multiplexing computers, which when used at local centres, . 
permit a number of simple and/or complex student terminals 
to share a common communication channel to the central 
computer. Methods of sorting and servicing messages 
arriving on such shared channels by the central computer 
are being investigated. System programmes involving two 
quite different approaches havis been developed for this 
purpose . 

Software techniques are also being investigated to 
improve the effectiveness of student operation of input 
devices. One example of such a technique is a programme- 
which can correctly identify words containing spelling 
errors. This programme takes into account the possibil- 
ity these may have been introduced as a result of a "keyboard 
error" caused by striking the wrong key, or possibly a 
transient equipment malfunction, or as a result of human 
error - the user not knowing how to spell the word correctly. 
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• ^ other research- which is expected to lead to 

additional computer facilities in the future is directed 
towards achieving voice input to computers and economi- 
cally feasible mass storage methods for use with library 
and curriculum materials. Work on storage devices is 
currently focussed on magnetic and semiconductor thin 
films. 

The N.R.C. program has^ as one of- its objectives^ 
the consistent classification^ indexing^ storage and 
retrieval of CAL curriculum and conventional library 
materials by means of the computer. Thus the student^ 
teacher or author will be able to manipulate and retrieve 
mateirialv using natural language commands, as an extension 
of the learning process. Consistent retrieval by computer, 
once classification and indexing are adequately achieved, 
is not too difficult; the greater problem lies in assigning 
classification and index terms automatically without -human 
intervention. 

The techniques used to accomplish automatic 
classification and indexing are statistical in nature but 
word counting is not used. For a given category, 
established either by htunan or machine means, a word list 
is produced automatically with appended probability values 
that the word belongs in that category* A document is 
indexed by testing its words against the words of each 
such category list, the word probability values being 
summed within each category for each match. The document 
is directed to the classification wherein the maximum sum 
is found. This approach permits the value attached to 
each word to vary with time as its usefulness as an index 
term changes and also allows the continuous updating of 
the word list as new terminology enters any established 
category. The uniqueness of the terms to a given category 
determines the probability value automatically assigned. 
The techniques used are independent of meaning and 
language; retrieval requests may be formulated naturally 
in the language of the document to initiate its retrieval, 
for the request is similarly analysed to allow matching of 
word lists. The output of the search' is ordered as to 
anticipated usefulness and the decision threshold is 
adjustable. Production of abstracts by computer is possible 
with the technique employed and the automatic correction 
or assignment of classification is now under investigation. 
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. A strong emphasis is placed on standards through- 
cut the program. Existing standards are adhered to 
wherever possible, and where existing standards do not 
adequately meet the requirements-, or no standards exist, 
representation is made to appropriate standards groups. 
It is felt that only by the definition of and adherence 
to acceptable standards can results of this work be made 
available on a widespread basis. Two areas in which it 
is particularly important that standards be achieved soon 
are those of programming languages for CAL applications 
and communication codes for use in Canada to permit 
efficient exchange of information between computer systems 
in both English and French. 

\ The medium scale time sharing computer, a Digital 

Equipment Corporation jPDP-lO, which forms part of the 
N.R.C. central research facility, provides a means whereby 
remotely located research groups can actively participate 
in the CAL project. Educational organizations throughout 
Canada can develop and evaluate course materials, evaluate 
system facilities, both hardware and software, and contri- 
bute to the definition of system parsuneters. The sharing 
of a central computer during the research phase permits 
course materials to be r^eadily transferred from one V, 
participating organization to another. The storage of 
course materials and programmes in on-line, machine 
readable files which are accessible to all participants 
means that there is little or no delay in the transfer of 
information from one group to another. Thus provided the 
originator of the material has supplied sufficient docu- 
mentation in the file, 'the recipient can make use of the 
material with very little delay. In this way, through 
the cooperation of several participating organizations, 
it is possible, to test a programme more extensively and 
under more varied conditions than if the testing was done 
by a single organization working in isolation. 

Currently five organizations have projects under- 
way which make use of the N.R.C. computer facility and 
others. are expected to join the system later in the summer. 
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The projects currently on the system are illustrated in 
Pig. 1. 

The first participating educational organization 
to go on line was the Ontario Institute for Studies in 
Education in Toronto which was linked to the Ottawa computer 
early in 1970. Initially this link terminated in Toronto 
at a single teletype which was used primarily for progranune 
development. Now , at the Toronto end of the line is a small 
time shared computer which serves as a line concentrator. 
By means of this facility, a number of individual student 
terminals connected to the line concentrator in Toronto can 
share a common communications link to the Ottawa computer. * 
Currently twelve terminals are linked through the O.I.S.E. 
computer in this way and consideration is being given to 
increasing this number. 

One phase of the current O.I.S.E. activity ^^'^^ 
represents a major contribution to the system facility. 
This consists of the development and testing of a cours«- 
authoring language interpreter, CAN6, along with the 
development of analysis routines for processing data 
gathered during experimental applications of the language. 
Entensive evaluation of the CAN6 language and system 
facilities is being carried out as a result of the develop- 
ment and testing of a computer-based remedial mathematics 
curriculum which the O.I.S.E. is undertaking in cooooration 
with number of Ontario Community Colleges. As part of 
this _ -,ject, there is a direct link from the N.R.C. 
computer to Algonquin College in Ottawa as well as the 
indirect links through the O.I.S.E. to several colleges and 
high schools in the Toronto area. 

At College Edouard-Montpetit , in Longueuil, a 
project is underway which is aimed at the evaluation of the. 
characteristics of the computer programming language LOGO,^^'^' 
which was developed by Bolt Beranek and Newman in cooperation 
with MIT and several other educational organizations. As 
part of this project, a French language version of LOGO is 
under development, as well as a line concentrator programme 
for a PDP-11 computer which will provide a nxanber of student 
terminals access to the LOGO facility through a common 
telephone line to the N.R.C. computer. 

As noted earlier, the University of Calgary has 
been cooperating with N.R.C. in the CAL work since the 
early stages of the project. The initial contacts between 
the groups were established in late 1967. However, 
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connection ro the Ottawa computer facility was not made 
until late in 1971 and is on a quite restricted basis 
because of the high costs of communication. Extensive work 
has been underway at Calgary for some time however using a 
small time shared computer. \7) ' As part of the Calgary 
project^ an experimental student terminal developed at 
N.R.C. has been supplied for evaluation. This terminal 
consists of a slide projector with touch-sensitive screen, 
an audio tape recorder and a conventional keyboard-sprinter 
unit, all capable of being operated under computer control 
through a single telephone connection to the computer. One 
of the objectives of the cooperative project with the 
University of Calgary is an investigation of the communica- 
tion and other problems ^ associated with the use of multi- 
media student terminals. Of particular importance is the 
investigation of the problems associated with communicating 
over long distances to such devices using common carrier 
facilities. 

At McMaster University in Hamilton, an initial 
investigation of CAL is currently underway as part of a 
study of science concept learning at university level. One 
of the facilities installed in a resource centre used in 
the study is a terminal linkCtd to the N.R.C. computer. One 
• of the objectives of the pxroject is to investigate methods 
of integrating a variety of learning resource materials 
with more conventional methods. Thus the resource centre 
contains, in addition to the computer terminal, a variety 
of audio-visual facilities aimed at providing an individual- 
ized approach to science teaching. 

At N.R.C. last year, an in house project was 
started, aimed at identifying and developing' the necessary 
facilities in a CAL system for satisfying the special 
requirements of students with learning disabilities. The 
initial work undertaken on this project has been the computer 
implementation of the Peabody Picture Vocabulary Test which 
'\ yields an.IQ score. The implementation of this test, which 
was carried out in cooperation with the Psychology Depart- 
ment of Carleton University, makes, extensive use of the 
special facilities provided in the experimental student 
terminal developed at N.R.C. It is expected that this 
initial work will be the first phase of an automated 
perceptual screening project to be undertaken by Carleton 
University's Department of Psychology. 

Project proposals from the University de Montreal 
and the Univerrity of Western Ontario have been received 
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and it is expected that research groups at these centres • 
will be linked to the N.R.C. computer when details have 
been worked out. 

Projects which make use of the central research 
facility must contribute to the achievement of the overall 
goals of the cooperative program. This contribution is in 
the form of helping to define and evaluate system 
characteristics, either hardware, such as special purpose 
terminal equipment, or software, such as special purpose 
languages and other software available for system support. 
It IS not the purpose of the program to provide a tool for 
purely educational research. The research must be related 
to the development of CAL facilities and techniques. Thus 
the focus of contact between the N.R.C. group and the 
cooperating educational organizatibnsf is the technology 
and the individual projects must re'fiect .this. The use of 
the computer is furthermore restricted to the research 
phases of the project. Once a project becomes operational 
and is to be run a.s a day to day service with the results 
of such operation not being used for research, it is 
required that other facilities be used. 

Use of the central computer facility has been 
building up over the past year and the benefits of the 
central facility are being demonstrated. As the project 
continues and problem areas are identified and resolved it 
is to be expected that use of the central facility will 
become considerably more effective over the next year. 

In closing, it should be noted that the interest 
of educational research organizations in participating in 
the cooperative project is much greater than the number of 
users of the system would indicate. However, the high cost 
of communications is at present a major deterent to 
potential participants who are located at any great distance 
from Ottawa. To make the program truly cooperative, it is 
our hope that equalized communication charges, independent 
of distance can be arranged. It is hoped that the use of a 
central computer research facility will prove its worth in 
CAL research and development and thus encourage similar 
programs of sharinct the study of other multidisciplinary 
problems through the use of modern communications 
facilities. 
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COMPUTER-ASSISTED MATHEMATICS FOR UPGRADING COLLEGE STUDENTS' SKILLS SESSION 5C 
By/Par: Dr. W. P. Olivier. ROOM/SALLE 143 

Institut ontar\.^n de recherche en education. 
The Ontario Institute for Studies in Education. 

The Ontario Institute for Studies in Education (OISE) and several Colleges of 
Applied Arts and Technology (CAATS) jointly are developing a curriculum for upgrading 
mathematics skills. The project uses the computer facilities of the OISE and the 
National Research Council for on-line diagnosis and instruction of inatheraatrcs skills. 
The Computer-Assisted Learning system software was designed at the OISE and implemented 
with a view toward independence from any specific computer; therefore all system 
programs are coded in widely standarized languages. Vhe authoring language, CAN-4, 
which is interpreted by the sys ten programs, allows the curriculum designer and student 
a large degree of flexibility in the instructional process. 

The mathematics curriculum material is designed as a set of modules keyed to 
behavioral objectives prerequisite for first year CAATS students. The project's goal 
is to provide the student with the most efficient means of instruction suited to his 
individual needs. Advanced assessment techniques requiring an on-line computer system 
provide valid decisions which can reduce", by seventy percent, the student^s time 
required for mastery of the curriculum^ Reports on the performance of each student and 
course are used by the project staff to improve the system and the teaching/learning 
process. 



CONTRIBUTION DE L'ORDINATEUR POUR ELEVER LE NIVEAU 

EN mathEmatiques des etudiants des colleges LOCAUX 

L* Institut ontarien de recherche en education, en collaboration avcc plusieurs 
colleges de technologie et des arts appliques (CAAT, en. anglais), elabore un programn.e 
pour elever le niveau des etudiants en mathematiques. Ce programme est base sur Ics 
installations de l*Institut ontarien de recherche en education et du Conseil national 
de recherches pour les diagnostics et I'instruction en mathematiques par liaisons 
immediates. La programmation pour le systSme d* instruction S l*aide d*ordinateurs a 
ete congue 1* Institut ontarien de recherche en education et a etc developpee en vue 
d'etre independante de tout autre ordinateur particulier ; done tous les programmes 
sont codes en langages bien connus. Le langage d*injection, le CAN-4, qui est interpretc 
par les pr<^ammes, donne ^ I'enseignant et S l*etudiant des moyens de se servir de 
methodes trSs souples d' instruction. 

Le programme des mathematiques a la forme d*un ensemble de modules hnse sur 
le comportement que I'on veut obtenir des etudiant?; de premibre annce des CAAT. Notre 
but est de donner S I'etudiant les moyens les plus efficaces d*instruction dans son 
cas particulier. Des techniques avancees d*cvaluation qui nccessitont une liaison 
immediate avec un puissant ordinateur, oermctLtnt de prendre des decisions valablcs 
qui peuvent reduirc de soixantc-dix pour cent le temps dont I'etudlant a besoin 
pour maitriser le programme. Des rapports sur les rcsultats obtenius par chaquc 
etudiant et sur le cours lui-meme servent aux experimcntateurs a ameliorer le syst^mo 
et le processus d'enseignement et d'assimilation des connaissances . 
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How often have you listened to speakers and read papers predicting 
the wonderful benefits of coirputer-assisted instruction (CAD? This 
paper will not be concerned with the future of CAI. The ccxnputer, with 
sophisticated instructional and testing techniques currently available, 
can minijnize the amount of information passed between cc3mputer and 
student. This jtdnimal information transfer thxis increases the effi- 
ciency of the learning process. The project which is reported here 
should give indications of the benefits of computer-assistance for a 
specific curriculum area with techniques and facilities available today. 

The Individualization Project 

The Individualization Project of the Department of Computer Appli- 
cations uses evolutionary, not revolutionary,, methods to provide 
students witii the most efficient instruction suited to his individual 
needs. Our project is a coordinated, multi-facetted approach to the 
problem of individualizing instruction through the use of a computer. 

Why use a computer? Simply because it is the ^•-'y general-purpose 
control mechanism which is capable of the treiuendous information- 
processing burden demanded by the individualization of instruction. 
Unfortunately, we know more about the designing of computer systems 
than we do about the ways of maximizing learning, retention and 
transfer while minimizing the student's time spent learning. 

The Individualization Project has designed CAI systems for small 
general-purpose timeshcuring computers and for dedicated multi- 
processor systems capable of processing hundreds of students 
concurrently* The computer systems (Churdiill, Naess & Olivier, 1969) 
have software for interpreting a special purpose course authoring 
language called CAN-4, registering students to use courses, checking 
language syntax of CAI programs and producing reports on student and 
curricular performance. Another component of the project accesses 
the suitability of available computer-student interface devices and 
designs such hardware when none is available commercially. Research 
projects axe also being conducted on individual learning differences 
encountered by the individualization of instruction. Last, but not 
least, a large scale mathwatics curriculum project is under develop- 
ment and showing extremely good results during the initial field 
trials . 

The benefits of working in such an environment with the cross- 
fertilization of ideas is enormous. In almost all cases, the system 
software and hardware is modified to enhance the utility of the 
curriculum software (courseware) , rather than the usual situation of 
restricting the coxurseware development. 
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The major focxas of this paper is to report on the development of 
a CAI curriculum for community college mathematics in Ontario. This 
sub-project is the major focus of our Individualization project; there- 
fore , the other components will be mentioned only briefly, v^ere they 
contribute to the mathematics sub-project. 

The first thought that probably enters one's mind is "Oh, I've 
seen many CAI math projects. Isn't the OISE just reinventing the 
wheel?" We think not. We hope that you perceive the benefits of our 
work by the conclusion of this paper. 

Needs and Goals 

Over several years and from several sources, such as the Ontario 
Mathematics Coirani^sion, it has been reported that a large proportion 
of students entering the community colleges .are deficient in mathem- 
atical skills. A mathematics deficiency meams that students lade the 
knwledge of mathematics necessary to pursue effectively their 
professional courses* The mathematical deficiencies are not limited 
to specific topics in mathematics* As a result of the demonstrated 
societal and institutional needs for a mathematics curriculum catering 
to individual differences, the OISE and several community colleges 
began development work with the following goals. 

1* To fill the need for high quality, original, individualized 
deficiency diagnosis of mathematical skills at the commxmity 
college level of instruction, 

2. to provide individualized remedial instruction in these skills; 
and, 

3* to do so at a cost which is acceptable to the agencies provid- 
ing the students with this instruction. 

Project Structure 

Although the OISE initiated the project, it is the users, the 
community colleges, which determine the interim goals and mecins for 
attetining these goals. Figure 1 shows the project structure* The 
Deans' Policy Committee is responsible for committing college resources 
to the project. The committee is composed of one member from the OISE 
and one Dean from each of the participating colleges* The Project 
Committee is composed of OISE staff, and teacdiing staff from the 
colleges aissociated with the project* This committee creates the 
mathematics skills specifications, designs tests to measure these 
skills and writes instructional sequences to teach the students. 
The Editorial Board is composed of one course author from each college 
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Figure 1. Project Structure 

and one representative, from the OISE whose members review ^ modify, and 
eventually approve all work done by the Project Committee. The 
Instructional Programming Group of the oiSE implements all approved 
materials on the computer facility* 

In June, 1971, Cambrian College at North Bay, and Algonquin 
College in Ottawa joined the OISE and Seneca College in the project. 
At this time a one-month workshop was held for the teadiing masters of 
the community colleges in computer-assisted instructional philosophy. 
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methods and implementation techniques* Staff from Fanshawe and George 
Brown Colleges also attended the seminars* Currently, instructional 
materials are being authored by the aforementioned colleges with the 
addition of Sir Sandford Fleming and Conestcga Colleges* About three 
hundred students from three Toronto high sd^ools are also currently 
using the curriculum* In addition to the prepamtory mathematics 
curriculum which has been developed, curriculum for first year business 
and technology mathematics is tmder devel^ment* 

Figure 2 shows the geographic distribution of the currently 
participating agencies whidi con^rise our project's effort* As you 




rigure 2* Location of Cooperating Agencies 

can see from the figure, the project encompasses an area from North 
Bay to Guelph to Ottawa* 

Computer Facility 

All of our users are connected over leased telephone lines to a 
small-scale, general-purpose timesharing conf>uter which runs a line 
concentrator program as one of its higher priority jobs* The line 
concentrator at The OISE is connected to the National Research 
Council's (NRC) large-scale timesharing computer by a single, high- 
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speed, leased telephone line (McLean, 1972) • By the use of the line 
concentrator computer at The OISE, we may allow about thirty students 
on the system while using space for only one job on the PDP-10 at the 
NHC. Most of our courseware development is conducted on a medium- 
scale, general-purpose timesharing system at The OISE, and when the 
curriculum is debugged, the materials are transferred to NRC*s 
madiine for field trials. The student performance data recording and 
reporting facilities implemented on the PDF- 10 allow us to make 
further refinements in the curriculvw during the field trials. 

CurriculXMn Materials Development * 

Let \is focus OMC attention new on the curriculum development 
efforts. Teachers from the community colleges have specified the 
behavioral skills reqtured for the target population students. The 
first task was to test the students to determine .what instruction was 
needed. Rather than follow traditional testing methods, three computer 
dependent techniques were chosen. 

CoBg>uter Generated Items 

Instead of storing a large set of specific test items related 
to a required mathematical skill, only one model problem is stored. 
This model problem is parameterized so that it can produce a random 
sample of test items, drills or examples within the determined limits. 
There is one model problem for each skill and it is estimated that 
by using the generative tedinique for creating specific items the 
computer storage requirements have been reduced eighty percent over 
previous tediniqiieS. Of course, computer generation of items also 
relieves the instructor of this chore while expediting the task 
of coding and debugging items. 

Sequential Testing 

A second tedinique uses a sequential sampling procedure developed 
by Wald (1947) for industrial applications. The traditional decision 
procedure draws a sample of a predetermined size and confutes 
statistics on this total saunple. Wald*s procedure samples items at 
random, until a dichotomous decision can be readied. This sequential 
procedure can reduce the required sample size by fifty percent. The 
implication is that the same information as to whether a student has 
a skill or not can be obtained with fewer test items and time. The 
way we have parameterized the Wald's Sequential Probability Ratio Test 
a student making frequent errors can take only two test questions, 
while a student making no errors may take at least four test questions 
(see Figure 3} . 
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Pigiire 3» Sequential. PrcbabiUty RBitlo Test 

'Ihd vertical axis shews errors and the horizontal axis shovs the 
total nuafeer of test itsM administered^ flhe two sloping lines indi- 
cate the points above irtiich a student demonstrates non-mastery on the 
test, and the area belov whidi the student passes « The area between 
the lines defines the no decision region* As a student takes more 
test items, his point is displaced to the right* Any errors also 
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cause an upwards displacement. Since it is possible to stay in the 
no decision region by making occasional errors, the testing procedure 
is truncated after a limited nunber of trials, and the decision 
region which will result in a minimal decision error is taken. These 
two facilities, generative techniques associated with the test items, 
and the sequential testing, would be difficult, if not inpossible, 
without a computer. The only storage requirement is one program with 
approximately fifteen lines to control the sequential testing, and 
one of approximately twenty lines for each model probU u 

Mathematics Skills Hierardiy 

The third facet of the computer dependent tedin.ique is hierarchi- 
cal branching. Most mathematics is considered hierarchical in nature; 
that is, certain skills are prerequisite to higher level skills. If 
a validated hierardiy is xised as a testing structure then all skills 
need not be tested. For instance, if a student reliaibly can find the 
product of two factors' each composed of tvo or more digits , then it 
may be inferred tiiat the student has the skills of "multiplication 
facts" and "columnwise** addition. Such inferences, if valid, let one 
bypass testing lower prerequisite skills if the higher level skills 
are passed. By using the hierarchical structure, a great saving in 
testing time can result. Ihe combination of the hierarchical branch*- 
ing and sequential testing techniques reduces the student's time 
involved in taking tests by 75% over the next best currently available 
testing techniques. 

In order to create empirically and stibsequently validate a 
hierarchy of relations between mathematics skills, it was first 
necessary to test a large, population of students in all the 
prerequisite skills. OISE staff members created a **paper-and-pencil" 
test designed to simulate the computer's administration of diagnostic 
test materials, 'ihis test was administered at Seneca College, Kenner 
Collegiate in Peterboto and Northern Secondary School in Toronto. 
Information received from this first cycle of testing was sufficient 
to construct and implement the first test hierardiy in September, 1971 

Hie skills which are included in the prerequisite mathematics 
are shoK^ in Table 1. For example. Figure 4 shows the skills 
specification for objective 6<1, whidi is one of the items of the 
complex fractions section. The student does not see the problem in 
the form shc^n in Figure 4, but rather, he sees specific values for 
the variables **a" , **b", "c" and •*d". The algebraic and set notation 
shewn under the problem's format are the rules used in generating 
the problems. The sets for the variables "c" and *'k" are numbers 
selected at random. Hhe variables "a", "b" and "d" are thus trans- 
forms of the random variables "k" and "c". 
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Table 1 



List of Mathematics Skills 

1. Fundamental Operations with Signed Integers 

2. Factoring of Integers 

3. Laws of Exponents 

4. Handling of Signs and Common Fractions 

5. Equivalent Coimon IPractions and Reduction 

to Lowest Terms 

6. Conplex Fractions 

7. Fundamentals of Decimal Notation 

8. Operations with Decimal Nianbers 

9. Significant Digits 

10. Algebraic Substitution 

11. Addition of Monomials 

12. Multiplication with Monomials and Polynomials 

13. Division with Monomials and Polynomials 

14. Monomial Ccmmor^ Factors 



Divide a fraction by a fraction. 

The question takes the form of the expression 

(a/b)/(c/d), 

where a « kc, b»k+l, d«k-l, 
c € {3, 5, 7, 11}, and k e {4, 6, 8, 10}» 



Figure 4. Skill Specification for Objective 6*1 



1^ 



-215- 



Instructional Strategy 



The instruction is typically a small amount of explanatory (ext 
follGMed by a few examples generated from the model problem for the 
skill. FollG%#ing the examples the student takes a drill similar to 
the test# but no^ he is told when he is wrong. Comprehensive answer 
analysis in the model problems is invoked to see if his answer, if 
wrong, could have resulted from applying an anticipated incorrect 
prooedxxre to the problem. If the student is making a corwon type of 
mistake he is made aware of this< and if it recurs he is taken to the 
objective lower in the hierardiy which teadies this skill. This is 
a review procedure for students who need it. While taking the drill 
the sequential pattern of the stuUent's response is continuously 
analysed by Waldos procedure to sec if a mastery or non-mastery deci- 
sion can be reached. 

Figure 5 shc^s the method of sequencing a student through the 
entire curriculum. This figure indicates that a student does not 
receive instruction on a .skill until he masters the prerequisite 
skills. The first level of instruction for each skill is designed 
to pass about seventy percent of the students. More comprehensive 
instruction is given to the remaining thirty percent of the students 
who do not adiieve mastery on the first level of instruction. 

Evaluation 

A preliminary evaluation of the project was conducted internally 
by Seneca staff. Table 2 shows the tabulation of these results. 
These results, of course, should not be taken as definitive, nor in 
any sense do they "prove" the benefits of this type of approach. The 
results from Seneca should be taken only as a preliminary indication. 
The major findings of Senecn*s internal evaluation are the lower 
dropout rates, near absence of failvres and drastically reduced time 
for the CAI group. 

Currently, The OISE is collecting performance data from all of 
the users and effecting a large scale evaluation study. 

Conclusion 

I have atten|>ted to show how the OISE and several Colleges of 
implied Arts and Technology jointly are developing a curriculum for 
i;^rading mathematical skills. The project uses the CAI facilities 
of The OISE and the KRC to administer generative diagnosis and 
instruction for mathematical skills. The mathematics curriculum * 
material is designed as a set of hierarchical modules keyed to 
specific behavioral objectives prerequisite for first year coiwnunity 
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college students. 

The goal of the project is to provide the student with ti c most 
efficient neens of instruction suited to his individual needs. The 
advanced assessment techniques requiring an on line coifputer system 
provide valid decisions iidiich can reduce by seventy percent the 
utudent^s time required for mastery of the curriculum. The project 
is nearing the end of the first year of field trials end soon will 
produce formal evaluative results; however, preliminary evaluation 
studies have indicated an enormous utility for this type of approadi. 
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Table 2 

Evaluation Stud/ by 
Seneca College of Applied Arts and Tedinology 

Group 

I II III 

Nature of Conventional Conventional CAZ 

Instruction 

i>*te SusMr •71 Fall •?! FaU •?! 



Student contact 

hours 28 . 40 6*28 



Nunber of students 
registered 40 * 41 27 



Nunlber of students 
vrtto transferred to 
another class 

Nuinber who passed 

Nuirider %iho failed 

Nusber who dropped out 



0 

24 (60%) 
8 
8 



7 (17%) 16 (59%) 

XO 9 in- ^ 

complete 

17 1 



These students did not complete the material 
and continued into the spring of 1972. 
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SIMUUTING AN IN'ST RUCTIONAL SYSTEM FOR AN EDUCATIONAL GAME SESSION 6A 

By/Par: P. David Mitchell. ROOM/SALLE Us 

Sir George Williams University. 
Universite Sir George Williams. 



Research and development activities to be described emerged from a twofold 
problem: How can the responsibility for learning be shifted from teachers to learners 
so the learner allocates his time or other resources to achieve preferred educational 
objectives and the teacher develops and evaluates strategies to assist the learner? 
How can the teacher-trainee be prepared for this role reversal? 

A computer simulation of an instructional system (i.e. a set of learners) 
is being developed. The game-player, cast in the role of a teacher, takes pre- 
instructional decisions. The model calculates coefficients for each decision, updating 
major sub-models within the simulation (motivation, instruction, information and 
activity states) for each learner in the simulated population with regard to several 
educational objectives. It prints results of educational assessments called for by 
the game-player. 

The game-player is able to test the effects of alternative instructional 
strategies and supportive action on the simulated students. The player may resort to 
lengthy trial-and-error , retrieval of information from various resources, discussion 
or higher cognitive skills. The onus is placed on the player to find one or more 
winning strategies. This is in keeping with the model ' s .assumption that the learner 
is an adaptive, self-organizing system which begins in a purposeful state and responds 
differentially to instructional communications and activities. Thus the Rame-player 
Is forced to adopt a learner-centered approach both experientally and in any winning 
Strategies-. ' ^ 

When the educational game is operational it will be tested with teacher- 
trainees, experienced teachers and others. Improved models of the simulated 
classroom are destined to become a new focal point for teacher training activities. 

LA SUfULATION P'UK MOPgLE D' INSTRUCTION D'U N GROUPK D'KLEvES 
COMME JEU EDUCATIF POUR LES ENSEIGNANTS 

o travaux de recherche et de developpement que nous decrivons sont nes 

d un^double probl^me: comment peut-on donner la responsabili te d'apprendre ^ I'el^ve 
plutot qu au professeur de sorte que I'eleve consacre son temps ou d'autres ressources 
pour atteindre des buts educatifs choisis et que le professeur developpe et evalue des 
moyens d aider 1 eUve? Comment peut-on preparer le professeur stagiaire S ce role? 

^ On developpe une simulation sur ordinateurs d'un syst^me pedagogique (c'est- 
a<-dlre, d un groupe d'el^ves). Le meneur de jeux, le professeur, prend des decisions 
d instruction anticipers. I.e moiSie calcule des coefficients pour chaque decision, 
mettant ^ jour les sous-mod^ltjs majeurs ^ I'interieur de la simulation (la motivation, 
1 instruction, les renseignements et les etats d'activites) pour chaque elSve dans la 
population simulee h I'egnrd de plusieurs objectifs educatifs. II imprime les resultats 
des evaluations educatives domandes par les joueurs. 

Le joueur a la possibilite d'c-ssayer les effets d'autres strategies educatives 
sur les el^ves simules. Le joueur pcut nussi faire des essais et des verifications 
de longue duree, recuperer Ins renseij»ncmont:s de differentes sources, discuter ou 
employer des techniques impliquant des connaissances superieures. C'est au joueur de 
trouyer une ou plusieurs strat^Ries ^aguanLcs. Ceci s'accorde avec 1 Mivpothbse du 
modSle que 1 el^ve est un systeme adaptiif a organisation propre, qui commence avec 
un but avise et qui repond, en di f f crenclant , aux coiiununl cations et aux activites 
educatives. Ainsi le joueur doit adopter une attitude d'eJSve desirant apprendre aux 
moyens des experiences et des strategies p^aRnantes. ' 

Quand le jeu educatif sera mis au point, on fera des essais avec des 
professeurs stagiaires, des professeurs experinentes et d'autres. Des modules 

"^f ^^^^^^ simulees auront une place tr^s importante dans les 

etudes des stagiaires de 1 'enseignement. 
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At Sir George Williams University we are currently 
attempting to develop an educational game in which the 
game player, cast in the role of teacher, will take pre- 
instructional decisions and a computer program will 
simulate an instnactlonal system and provide Plausible 
instructional outcomes for a set of students/ This paper 
provides an overview of the educational simulation (EDSIM) 
project, 

'THE MANAGEMENT OP LEARNING 

Recent educational technology research and practice 
has emphasized not only the institutionalized replacement 
of some instructional functions of the teacher by other 
means and nodes of instruction but also the changing 
nature of the teacher's role toward that of manager of 
the educational process. Somewhat disquieting is the 
realization that little has changed in teacher-training 
practices to implement this. 

The typical teacher-training program focuses on 
knowledge and understanding of the discipline as well as 
on teaching methods. But it gives only lip service to the 
transformation of discipline content and psycho-social 
sciences into pedagogical practice through mediated 
instruction and learning systems. The teacher is left to 
his own devices while pursuing the elusive state of 
omnicapability. Yet the classroom teacher cannot be 
expected to develop the kinds of learning resources and 
environments likely to prove necessary; it must be a large- 
scale effort to be economically feasible. Admittedly a 
teacher may prepare some learning and instructional 
resources but not in sufficient quantity and quality to 
make effective use of his time and talents. One promising 
development is the trend to multi-purpose classrooms 
characterized by small groups of students working on 
defferent projects. Another is that learning resources are 
gradually becoming available in schools and universities. 
However there is still a problem; how can we help the 
beginning teacher learn to design and manage the conditions 
of learning for his students? 

A closely related problem exists. Emphasis on 
technological efficiency in Instructional communications 
could destroy efforts to develop self -regulated learning 
strategies on the part of students. For the basic Issue ''is 
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not the Improven ent of teaching but the iniprovement of 
learning. This is a subtle point based on the assumption 
that the activities and attitudes of the student are 
necessary (and often sufficient) whereas those of the 
classroom teacher or instructional system may be necessary 
but are certainly not sufficient. ITltimately the student 
is his own teacher J he must come to see that he is 
responsible for his own education -and that his experiences 
and activities produce changes in his cambllity. Probably 
most students would fail if they did not teach themselves 
outside, tnd even inside, the clftssroom. So the student, 
as much as the teacher. Is the manager of learnln/rj thev 
must collaborate. r j 

THE PR03LEK 

The problem is twofold t How can the responsibility 
for learning be shifted from the teacher to the student so 
the latter can allocate his time or other resources to 
achieve his assigned of preferred educational objectives 
While the teacher functions as a manager of learning 
resources for his students? How can the student of 
education be prepared for this role? 

A SIKULATED CLASSROOK 

Although other possibilities exist, current research is 
based on the hypothesis that simulation and gaming methods 
which have emerged in military and business settings may 
provide a useful approach to this problem. The simulated 
environment provided by a game usually is less complex, 
and therefore more manageable, than the actual situation 
It has pedagogical advantages such as more rapid knowledge 
?ni-I^oiJtA«T°''*'^^?^®^ !° various strategies without 
? " * fff^ system»or the possibility of testing 
theoretical propositions more readily. Further, an 
educational game can be designed so that other resources, 
such as books, media, other game players or faculty 
consultants, are required for a meaningful experience on 
tne part of the player. 

AM OVERVIEW OP THE EDSllA PROJECT 

There exists a plethora of descriptive and explanatory 
literature concerned with education. Instruction and 

lf.t^A^' 4 iln^^JJ® °^ ^^^"^ progress has been made 

toward a viable theory of instruction, much less a 
generally applicable quantitative model. Yet a quantitative 
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model of the instructional process— no matter how crude-is 
required if a computer simulation is attempted. For such 
Simulation is a "numerical technique for conducting 
experiments on a digital computer, which Involves certain 
types of mathematical and logical models that describe the 
behavior of an . ../organ izeti/ system (or some component 
thereof) over extended periods of real time" (IJavlor. 

d«JJ^?f?' ^y^^lS^ ^^^l;'' 1966, p. 3). AmoreprecJs; 
definition is ""x simulates y" is true if and only if (a) 
svSL^ ?.? systems, (b) y is taken to be the real 

miiy ISi ^° ^® ^ approximation to the real 

l^^^u^ln^^ r^l®^ °^ validity in x are non-error- 

free" (Churchman, 1963, p. 12). 

whinh*^rj»r«^^ °^ simulation is operational gaming, in 
w?iMn%Sr?? same-player participates as a decision^taker 
wr?? L ® Jt^ructure of the system, being simulated.- EDSII>' 
mxl be such an educational game. 

OBJECTIVES 

o^^o-.rf^^vJ"^®^"^®^^^®'^ ^^""^^ objectives which will reauire 

considerable research extending over a two or three year 

period have been delineated! ^ 

r^r^^i^l^ We will develop a simple and crude conceptual 
SmcJ; wfni®?"'®'' ^ adaptive, .self-organizing system 
which begins in a purposeful state and responds 
n^iJwfr f^i'' ^° educational communications designed to 

then be ;ef?^«r.°^i"'?r£j ^y^^^"' ^^^^ "»°del w?ll 

in?S^!*.f«5 /? JM'^® l^^^^ psychological and other 

teachers' opinions) and transformed 

ihe Mnds hpJoSff "^'^l^^^^ l^*^"' ^^^'^^^ approximates 
Jhe Kinds of behaviour and decisions likely to be observed 
in a realistic, albeit restricted, instr^ictional system 

t^m V the model of a learner has been developed it 
Tnsir^nf?^f * Simulated student upon which various 
theJr«Jf2"?i strategies can be tested for 

rneir effects. This "standard learner" will serve as an 

«?f!™irf *J ^^^^^^^^ Of education So wilf 

^"l^T^ff poslcive increment in the model's 
capability state (i.e. the learner's knowledge, attitud^^s 
or behaviour) with respect to specifiS obJeftivts As a* 
rl??sed?' ''''' '^'^'^ '"^^^^ doubtless Tiula^e to be 
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3) Several standard learners can be generated from the 
basic model. They may be duplicates of the original or can 
be made to differ simply by changing initial values of the 
purposeful state. The set of learners, which makes up a 
simulated classroom, will form the core of the educational 
game in which the game-player, cast in the role of teacher, 
takes pre-leaming decisions regarding selection of media, 
modes, or content of instructional communications or 
alternative educational activities. The simulated 
instructional system will update the cambility state both 
for each learner and for the class as a whole with regard 
to several learning or activity objectives. ' 

k) The simulated instructional system will be used as 
a learning aid for students of education. 3y encouraging 
them to utilize a variety of learning resources in 
developing a winning strategy for the game (which itself is 
learner-centred) , the game may help teacher trainees to 
adopt a learner-centred approach to education. More 
importantly, it will jprovide practice in thinking precise!'' 
about learning needs and it should promote flexibility in 
managing learning resources to meet such needs. 

THE EDSIK MODEL 

Presently sought is a flexible simulation model which 
permits the user to specify the number of students to be 
included ih the instructional system (to a maximum of 
thirty) and initial characteristics of each (e.g. slow 
learner, under-motivated, highly motivated). At present, 
however, no attempt is foreseen to permit the user to 
generate alternative models of human learning} the 
"standard learner** will remain the core of the model. 
Ultimately such flexibility may seem desirable. 

The EDSIK is thus to be a simulation game involring a 
hypothetical class, which is simulated by the computer 
program, and a teacher or game player. The model is based 
on assumptions that are not entirely realistic, in the 
interest of simplicity. For instance, although some 
flexibility exists in stipulating student characteristics, 
only one model of learning style is planned. Therefore all 
students are essentially identical even though they will 
not appear so throughout the game, r-iore realistic and 
complex assumptior.s can be accommodated at a later date 
if desired. 
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In real life, the teacher may play many roles in 
fulfilling his responsibility to the student and society. 
Yet the EDSIM model permits the game tjlayer only a limited 
n\«nber of alternative activities to bring about changes in 
the capability state of simulated students. Wo attempt will 
be made to include classroom behaviour problems; the aim 
is to focus on pre -instructional decisions (e.g. lesson 
planning) of the teacher and their probable oi.C s on a 
simulated classroom. In practice, other methods of 
teacher training such as interaction analysis, in-basket 
studies, micro-teaching or practice teaching may be expected 
to supplement EDSIM. 

Another limitation, the curricultun, may be turned to 
advantage. The present intention is to limit the 
curriculum to a set of ten mathemata (from Greek? 
mathemata = things learned) . The mathemata are to be 
structurally organized so that some mathemata are more 
easily learned if certain of the others have been learned. 
In such a hierarchical arrangement (cf. Gagn^, 1965? I968), 
if mathemata subordinate to higher-order mathemata have 
been learned, there is a high probability that the student 
can display the higher order capability (assuming adequate 
instructional communications). On the other hand, the 
probability is low if the prerequisite capability is 
missing. This does not rule out learning in the latter case} 
a finitely large number of instructional acts may result in 
the learning of both higher- and lotfer- level mathemata. In 
the present model, this practice, while possible, is 
extremely inefficient in use of time. Because the g-ame 
player will be given only a verbal description of the ten 
mathemata in the curriculum, not a chart, he must 
implicitly, or perhaps explicitly, devise his own teaching 
strategy for the mini-curriculum. Appropriate references 
and resource material on curriculum development will be 
provided for his use. Thus the curriculum is not limited to 
any discipline but should be easily interpolated by the game 
player to fit any convenient subject. However, it will be 
limited to the cognitive domain of educational objectives 
and the lowest levels of the affective domain. 

To begin playing the game the player Is required to 
take several decisions, for example i what is to be taught 
in the forthcoming period, whether he will teach the entire 
class, a designated group, or only one student; whether to 
assign homework, give a test, or teach a learning strategy; 
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S™^Jfo^ relevant mathemata, etc.. 

Essentially the model allows only ore topic to be taught at 
a time but more than one may be taught i^ a period. A set 
Of pre-instructional decisions for a period is read into a 
?S2^ro^r>,???J ^^t been programmed xnth models that alter 
the capability state of the students as a function of the 
game player's decisions. In addition, chan^ pla?s a ^Sle 
in detennining the learning outcome. 

In brief, the model calculates coefficients for each 
decision on the part of the game player These 

So ""^^^ *° o«e*or mo?e of the 

sub-models within the game (viz. motivation 

-Sff^^r* activity, and capability states) 

^he importance of the motivation sub-model in this rame 
cannot be overemphasized. The model assumes a ?enefal 
motivation to engage in leaitiing, within o? beyond fhe 
^oS^^S?"' f"? f Jnotivation to undertake s pec !f?c learning 
de?eL?«iT^f .i^T'^ specified outcomes as might ^f^^'^^ 
co«?ri2 °^ student. Motivation state 

^d wi?? S f by appropriate instructional communications 
and Will be enhanced if the student is tau/rht learning 
strategies independent of the curriculum! -teaming 

i«„-n?w^^f^^2 sub-models would mimic what is 

Inutitively obvious and relevant in learnintr Tnfn,n«oi-i«», 

wefi^rof^h^ " "^'"'T ?'P^^--titr^^^^ 

well as of the number of students involved in instruction in 
a given period. Test performance is closely related to Jhl 
student's capability state but may va?y? leLSdJn^ on 
circumstances at the time of testLg. " Md clpaMli?y 
Itself may be dynamic and directly observable or latent 
(l.e. presumed to exist but not demonst?I?ed' c?.Muchell, 

SUCCESSFUL GAME PLAYING 

Tierlod^® ^l^l ^^.f si»"lated fifty minute operating 

^"w® ^^'^^ teaching act uses up an arbitrarily 
tll^^f minutes, only a limited number o? ^ 

teaching acts nay occur in any period; the game player is 
thus encouraged to be economical in his use of timef 

eff^rJ^^?^^??"" same will be able to test the 

effects of alternative instructional and leaminp- strategies 
?Sil?%nf students. The player may iTsoit to lengthy 

trlal-and error retrieval of information from various 
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resources (to be provided), discussion with teachers, " 
students, or fellow trainees. Or he may rely on his ovm 
cognitive strategies for probler.i solving. The onus is 
placed on the playor to find one or more winning 
strategies. This is in keeping with the model's 
assumption that the learner is an adaptive, self- 
organizing system which begins in a purposeful state and 
responds differentially to instructional communications 
and educational activities. The gamo ulayer, then, is 
forced to adopt a learner-centred approach both 
experientially and in any winning strategies. 

The game might be organized in either of two ways. 
First there can be a time limit placed on teaching whereby 
the 'course' terminates at the end of a specified number 
of instructional periods. Teaching effectiveness of the 
P}^y«r could be determined by an assessment of what the 
class has learned. The second mode involves running the 
game until a specified number of students has reached a 
predetermined criterion. Thus time would be tre&ted as 
a variable and degree of learning as a constant j teaching 
success is then a function of time required for the player 
to achieve this criterion. 

In either of the illustrated tdaying modes, the 
player can compete against his own past performance or with 
other players, or he may be required to achieve a 
predetermined criterion. 

When the educational game is operational, we plan to 
test it with a suitable class of education students and 
assess its effectiveness in combination with traditional 
approaches in training education students to apply their 
academic courses to instructional problems. Appropriate 
learning resources will be selected or Produced to" assist 
the game player who wishes to improve his performance. 
The game players' reactions will be sought. Improved 
models of the simulated instructional system seem destined 
to become a focal point for teacher training activities. 
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THE USE OF A TERMINAL BASED SIMULATION IN SESSION 6B 

MAN\\GKMi:XT l;DUCATION ROOM/SALLE US 
By/Par: John R. Abrahams , Sandy Douglas 
Rycrson Systems Institute 

The education of computer user management is being recognized by an increasing 
number of organizations as a good method to improve communications and the effectivlty 
of computer services. One way. it can do this is by removing the sometimes deeply 
engrained distrust of the computer and by showing its real capabilities »nd limitations « 
With a more positive attitude^ the user m;nager is able to look around his o\^n department ^ 
technical specialty or profession and identify some possible opportunities for 
computerization. He will also be more likely to interact ' successfully with the Systems 
Department on systems projects which affect his area* 

A terminal based simulation has been found to be one of the most effective 
methods ol removing the fear of the computer and showing its capabilities. In the first 
place, the simplicity of the terminal permits students to grasp the function of the 
computer without being overawed by the complexity of the hardware. Secondly, thoy are 
put in « position where they actually control the computer through the terminal and 
use it as a tool. Thirdly, it is a good springboard for a relevant discussion of many 
aspects of computing and particularly time-sharing, telecommunications and simulation. 
Finally, the terminal based simulation will bring the class together in working groups 
and effectively initiate participation and dialogue. 

Over the past 18 months, Ryerson Systems. .Institute has written 3 such 
simulations of increasing complexity and used them extensively in both user management 
education and in Systems Analyst education. 

L'UTILISATION P'UN TERMINAL EN SIMULATION UTIKISfiE 
POUR FORMER LE PERSONNEL DE GESTVON 

Des organismes, de plus en plus nombrcux, reconnaissent que les ordinateurs 
$ont utiles pour former le personnel de gestion, pour amfiliorer les relations entre 
humains et le rendemcnt des ordinateurs. L*une des fagons doni ils peuvent le laire 
est de dissiper la mSfiance, souvent profonde, i I'egard de I'ordinateur et de jnontrer 
set. applications fiventuelles et ses limites. Si le gcrant qui *i'en sert a une attitude 
favorable, il peut, en cherchant dans son departement, dans sa sp6cialit€ technif^ue ou 
dans sa profession, trouver des possibilitfis dci st> servir de I'ordinateur. II aura 
probablement aussi plus de succ^s dans ses rel&tions avec le Depnrtoment des syst^mes 
au sujet de ses travaux. 

La simulation l*aidc d*un terminal apparait comme I'une des meilleurcs 
nSthodes pour surmonter la peur cprouvcc en face de I'ordinateur et dc montrer ses 
possibilitSs. Tout d'aboM, la simplicit6 du terminnl permet aux itudiants dc 
comprendre les fonctionR de I'ordinateur sans etre intimides par sa compl^xito. D^nutre 
part, ils peuvent eux-mcmes controler I'ordinateur par 1 ' interm^diaire du terminal et 
I'utiliser comme outil. Une troisi^mc raison se trouvo dans le fait que le terminal 
est un bon moycn de decloncher une discussion pcrtincntc sur dv nombronx aspects de 
I'cmploi de I'ordinateur, soit ^ temps partagc, soit pour la simulation ou las 
tfilficommunications* Enfin, la simulation 7i I'aide de terminaux riMinini les cl^vos 
de la classe sous forme de groupes de travail et ellc rendra cfficaoe la particl pation 
et le dialogue. 

Durant les dix-huit derniers mois, le Ryerson Systems Institute a programme 
trois simulations dans ce cadre, de difficulte croissante et il en a fait un usage 
nonsidfrable dans la formation de ggrants et d*analyscurs de systbmes. 
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The Use of a Terminal Based Simulation 
in Han ag ement Education 
Providing education In the use of the computer to diverse 
groups of management ^nd computer professionals creates some 
Interesting problems* At the Ryerson Systems Institute, we 
have found computer based simulations to be extremely valuable 
tools for solving some of these problems. Over the past two 
years» we have written three such simulations and used them 
In a wide range of courses, 

Ryerson Systems Institute was founded in April 5970 and 
Is part of Ryerson Polytechnical Institute in Toronto. Th« 
aim of the Systems Institute Is to provide education in the 
area of information processing to both managerial and techni- 
cal staff in government and business. In order to do its job 
more effectively, it carries out applied research in informa- 
tion processing education and provides a centre In which In- 
formation processing professionals may share ideas. Though 
a part of Ryerson Polytechnical Institute, the Systems Insti- 
tute is financially self-sufficient and partially supported 
by a consortium of major Canadian companies, ft is governed 
by Ryerson, representatives from the consortium members and 
representatives of each of the three data processing, pro- 
fessional associations. The Institute, In cooperation with 
the Data Processing flanagcment Association, has instituted a 
comprehensive series of evening courses and these wlli be 
made available to other educational institutions in the near 
future. In addition, In-house or specifically tailored courses 
have been prepared and presented for numerous organizations 
including Imperial Oil, Simpsons-Sears, Shell, The Canadian 
Institute of Chartered Accountants, Royal Bank, Oomtar. CJ.L., 
Public Service Commission, Canadian Armed Forces, Toronto- 
Dominion Bank and C.N. A. Assurance. 

Courses are designed for two rather dissimilar groups 
of people. The first group contains manager-users v/ho 
hope to gain an understanding of the computer and business 
systems generally. This grou does not cone to learn speci- 
fic skills bet rather Is eager to gain a general understanding? 
of the area. The company which sends them is hoolng that 
they come back with a positive at'ltude towards computer sys- 
tems and the ability to Interact successfully with the systems 
department. Numerous, well publicized computer system failures 
and a history of the computer's doubtful contribution towards 
profit in many organizations ensures that many of these managers 
come to the course deeply skeptical. Others, fear that the 
computer wlil mean the technological obsolescence of ♦their job 
and they come very guarded or even bitter- The grcai problem. 
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therefore, ?c how can we affert a change of attitude. One, very 
effective answer Is to break down the barrier between man and 
computer by allowing him to ''play" with tt, to use it, to mani- 
pulate it and to control it. A simulation allows this. 

How does a simulation encourage user?to work K.>h and con- 
trol the computer? It does so by allowing him to stay on his own 
ground while the computer handles the unfamiliar aspects of the 
situation. The manager/user most often need do no more than 
manage effectively in using the simulation. Let us take an ex- 
ample. A group of retail store buyers have come to a course and 
for the reasons mentioned may be a little skeptical or dubious 
about the coinputer. After a short introduction, they are divi- 
ded in to. management teams and each given a booklet describing 
the cortiputer-based simulation with which they will be dealing. 
Although they are somewhat doubtful at first, they realize from 
reading the booklet, that they are on familiar ground. The simu- 
lation is of a retail market and all they need do is make the 
merchandising decisions, with which they are completely familiar. 
The simulation program will act as the market and show each team 
the effect of their decisions at regular intervals. Teams set 
prices, order merchandise and establish stock levels; then the 
simulation program produces the resultant sales for each item. 

The most important aspect of this approach is that it ini- 
:ially portrays the computer as a valuable tool rather than as 
a mystifying black box. The approach emphasizes useabiiity. 
From this point the discussion of almost all other areas of com- 
puting can be approached without, or at least v/!th less, problem 
from attitude barriers. What a program is and how it is used 
can be illustrated using the simulation progran. The principle 
o^ Input - Processing - Output becomes evident as the partici- 
pants use the computer. Depending on which is boina used, 
either the minicomputer or time-sharing can be effectively de- 
monstrated and the team members given an opportunity for hands 
on experience. The question of what is jinuiation and how can 
• t be appUed to business situations can be answered and parti- 
cipants will be encouraged to consider on the jco situations 
where it might be applied. Finally, it can act ss a sprinq- 
board for a discussion of systems and computinq 5n their own 
sphere of influence. Could the output be more effective, more 
detailed, more specific or better organized? Could the pro- 
cessing be done differently and is the data captured in the 
system adequate in terms of the output and objectives? 

The second group of people which our courses address is 
the Information processing professional; most coninonly these 
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are Individuals aspiring to become Systems Analysts. A Systems 
Analyst Is the person who researches computer user's needs and 
translates them into a computer system. These people come from 
two, quite different backgrounds in almost equal numbers* The 
first background is computer programming and in some cases, 
computer operations. They usually have an adequate understandin 
of computer equipment but rather little appreciation of business 
organization and information flow in business. The second back- 
ground Is a user area. These people usually have a good under- 
standing of the organization, the needs of the user area, the 
flow of information and any organizational problems which might 
be encountered, but they have inadequate equipment knowledge^ 
The approach, therefore, in providing systems analyst education 
Is to provide exposure to the areas that are not part of an in- 
dividUaTs background. Handling these groups is further compli- 
cated by the fact that classes usually contain representatives 
from both areas. 
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Once again, a simulation in which participantrwork m te.ims 
IS one effective tool for dealing with the problem. A prooerly 
designed simulation will identify characteristics and problems 
of the business environment as well as illustrating characteris- 
tics of the technology. Participants who have a data processing 
background can get a feel for the information requirements of a 
"^^^.^r^^ and some of the problems of management. Without 
realizing it, they may begin to think like users csp.d that cnn 
have a very beneficial effect on their ability to communicate 
with user groups. Participants with a user background will, of 
course, benefit from exposure to a computer and to simulation 
In much the same way that the manager/user groups did. An In- 
teresting side effect that comes when using a simulation in a 
group with different backgrounds is the way v/hich it will get 
them working together. It is certainly v;orthwhile having 
computer specialist and user specialist working together as 
this cooperation is critical for effective systems work. Like 
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so many actual instances, a simulation can make these two groiips 
collaborate on a computer based problem^ which paradoxically iSy 
be solved most effectively through the us^'s contribution, ^ 

As an example, a group of employees is on a course from 
a large bank. A portion of this group has come from the data 
processing area and the remainder from various user areas, such 
as branches, accounting, the mortgage department and others. They 
are divided into teams of four or five and given a booklet descri- 
bing a simulation. In order that neither group has a marked 
advantage, the simulation deals with an unrelated business. It Is 
more elaborate than the first one we mentioned and requires more 
complex decision making and constant communication betv/een team 
members. The teams in this case must run a manufacturing company 
by making decisions on production and stock levels and bidding for 
orders from customers. The computer reports their performance in 
a statement at the end of each simulation week and poses other 
problems like fires, strikes and equipment breakdowns which the 
teams must deal with. To be effective, each must pick a specialty 
such as General Manager, Sales, or Accounting, they must devise an 
organization structure and a system of communications. 

This immersion in a simulated business situation has been 
shown to help the potential systems analyst think like and relate 
to management. Secondly, he does gain a better understanding of 
Information flows and requirements in user areas. Finally, it 
offers the problems of effective team work^v/hich many individuals; 
particularly programmers who are accustomed to working alone,may 
not have experienced. 

The Systems Institute has made an attempt to satisfy it*s 
requirements by writing three simulations. Others will be written 



as required for specific courses or clients 
description of the three. 



Here is a brief 



Searton Fashions is intended for use in ccouter appreciation 
off manager/user courses. It Is the shortest in terms of cIass 
time, taking only two and one-half hours and is the least compli- 
cated for the participants. The recommended t^rni size in this case 
is three to six persons and four teams Is considered a maximum. 
It was originally written for a high school course, known In Ontario 
as "Information Processing Concepts'^but has been used with a number of 
groups since then. ' Interestingly enough, it has been used exten- 
sively with buyers from Simpsons-Sears Limited who have definitely 
enjoyed it and provided valuable feedback v/hich we have Incorporated 
Into the simulation. Searton is most effective when run manually 
for three simulation weeks and then through the terminal for seven. 
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This approach demonstrates, very graphically, the computer's 
ability to remove onerous clerical chores and allow time for 
effective d»^cision making. 

Computer Utility Management Corporation Is a simulation 
which can be used in either type of course. In this simulation, 
the participants manage a company which sells computer time* The 
teams must set prices, plan advertising and service standards for 
each simulated quarter and the computer report's their performance. 
It takes approximately three hours of class time and will accomo* 
date up to four teams of two or three persons. It Is a good ^ 
vehicle for introducing the basic Ideas of time sharing as in 
effect ''the medium is the message^'. It highlights the financial 
aspects of such a system and identifies some of the technical pro* 
blems which may be Inherent. Although It was originally used in 
"computer appreciation" courses. Computing Utility has been pur- 
chased by several large organization, such as the Public Service 
Commission, for use in Systems Analyst training. It is often used 
In answering the question *^\vhat Is and how can we use a simulation 
program?" 

Plastics I ncorpo rated is a general-purpose business simula- 
tion which dramatizes the communications problems and Information 
requirements within a management team. It Is used primarily in 
systems analyst or management education^ although it has been employed in 
more elaborate manager/user courses. In. this simulation^ the 
teams must set up a management team with specific job assignments 
and a definite communication system. They will then act as a manage- 
ment team in the environment simulated by the computer. Many de- 
cisions have to be made each simulation week and some interesting 
exception conditions have to be dealt with. Obviously^ the success 
of the team depends to a large extent on its ability to organize^ 
define authority and communicate. This is the largest of the 
current simulations and reqvu res from six to fifteen class hours. 
It can acconiodate up to four teams which consist of a General 
Manager, an Accountant » a Sales Manager^ a Production Manager and 
a Systems Analyst. In addition to its use in Systems Analyst 
training^ it Is used In the final yenr of an Industrial Engineering 
degree and in several systems management courses. 

Now for a few of the technical details of these simulations. 
All of them were originally written for use on time sharing ser- 
vices » such as IBM/CALL 360. This arrangement was advantageous 
since it made the programs available across the continent and a 
number of our larger clients already had this service. They can also 
be run on a variety of mlni-and full size computers. All of the pro- 
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grams are written in BASIC because of its capability and exten- 
sive availability on both mini -computers and time sharing services. 
A variety of terminals can be used, varying from a teletype, 
through IBM 27^1 to video terminals sijch as the Lektromedia'unit. 
Total running costs on a time sharing service are around $10 per 
hour. The simulation program sizes are as follows: 

Searton Fashions - lOk bytes 

Computer Ut 11 ity - 9k bytes plus one file 

Plastics Incorporated - 23k bytes plus one file 

These simulations in the form of program listing and paper tapes are 
available for purchase. 

The ratio of design and test time to classroom time varies with 
the size of the simulation. The shortest simulation had a ratio of 
about 60 to 1, runs for about three hours in the classroom and 
therefore the development time was about 180 hours. At $10 per 
man hour, the simulation cost some $2.,000 to develop from scratch. 
The longer simulation had a total development ratio of about 200 to 



Each of the programs can handle up to six teams and four teams 
seems to be the optimum number. With four teams, each team member 
spends two or three minutes per hour, actually using the terminal. 
We have also found that the simulation should normally occupy about 
20? of total course time. 

You will have noticed that this approach is not one-for-one 
C.A.L. Neither, however, is it a batch processed business game. The 
simulations can accomodate from six to sixteen persons per terminal and 
If necessary more than one terninal can be used. This makes it 
possible to Incorporate the simulations into courses easily since 
the whole group can be involved. The team work stimulated by this 
approach Is also an Important asoect of a number of the courses In 
which the simulations are used. Unlike a batch processed business 
game, these do give the teams constant feedback on their pronress. 
They also force the participants to plan at the some time ns" they 
handle the constant crises or exception situations that typify 
business. In addition, the simulations permit or'- instrv.-lor to 
control a case study situation more effectively thon in the past. 
The Plastics Incorporated simulation, when it was done manually, 
required one frantic instructor for each of the four teams. One 
Instructor can now easily control the entire simulation. 

In conclusion, we, and others who have used these simulations 
have found them to be dra-notic teaching vehicle suitable for a wide 
variety of Instructional situations. 
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TEACHING PR OPOSITIONAL CALCULUS WITH C,A,L, USING APL SESSION 60 

By/Par: D. Vaskevitch, ROOM/SALLE 1A5 
Erindale College, 
University of Toronto. 

This paper describes a series of lessons designed to teach Propositional 
Calculus which can be used by anyone from school children to university graduates. The 
lessons are written in the form of games based in many respects on a commercially 
available kit called "WFF'N'PROOF" which has been very successful in motivating students 
to learn symbolic logic. 

In most CAL lessons, the dialogue between the student and the computer is 
rather one-sided: the computer asks a question and then alters the presentation of the 
lesson based upon the student's response. However, the student has no way of a-king 
questions of the computer. 

In these lessons, the student is given many opportunities and even 
required to ask the computer questions. These questions, which take the form of theorems 
to be proved, are set up in the highly formalized notation of the propositional calculus. 
The computer responds by actually constructing a detailed proof of the theorem and if 
necessary leads the student through the proof line by line. This paper explains how 
the lessons are written and includes a discussion of the theorem prover used to construct 
the proofs using the method of subordinate proofs. The use and implementation of these 
games and lessons at Erindale College are discussed. While there are not yet sufficient 
lessons to teach all the rules of inference, those already available have been very 
successful. 

L'ENSEIGNEMENT DU CALCUL PROPOSITIONNEL A 
L'AIDE D'ORDINATEURS ET DE L'APL 

Nous dficrivons une scrie de legons con^ues pour enseigner le calcul 
propositionnel & I'usage de tout el^ve, depuis les elfeves des ecoles jusqu'aux diplSmes 
universitaires. Les legons prennent la forme de jeux bas€s, sous beaucoup de rapports, 
sur un Jeu que I'on peut trouver dans le commerce appelg "WFF'N' PROOF" qui a eu beaucoup 
de succSs pour encourager les el^ves 1 apprendre la logique symbolique, Dans la 
plupart des legons EAO, le dialogue entre I'etudiant et I'ordinateur est plutSt unilateral: 
1 ordinateur pose la question, puis il change la presentation de la leqon selon la 
rgponce de I'glSve. Par contre, I'el^ive n'a pas la possibility de poser des questions ^ 
1 ordinateur. 

Dans les legons que nous proposons, I'glfeve peut et il doit meme, poser 
beaucoup de questions I 1 'ordinateur. Ces questions, qui sont sous la forme de thcortSmes 
a^prouver, sont posees sous la forme de la no. ation trcis formelle du calcul propositionnel. 
L ordinateur repond en faisant une demonstration dStaillSe du th€orSme et, si necessaire, 
il entralne I'elSve, pas a pas, jusqu'^ la fin de la demonstration. Nous expliquons 
comment on ecrit les lemons et nous discutons de la methode de demonstration basee 
sur des demonstrations subordonnces . Nous discutons de 1' utilisation et de la mise en 
oeuvre de ces jeux et de ces lemons au Coll?5ge Erindale. Quoiqu'il n'y ait pas encore 
assez de legons pour enseigner toutes les regies de deduction, celles qui existent ont eu 
beaucoup de succ^s. 

Copyright: WFF'N' Proof - Learning Games Associates 

1111 Maple Avenue, Turtle Creek, Pa. 15145 U.S.A. 
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ThJ.s paper describes a project ciirrcrclv luvlor acLivc 
developnent at Krindale College. The purpose. oZ V-z nroject i.^ to 
design and inplenent a package, in the l^.n-u^c.^, -,aitnl-.lc ^or 

teaching cl>inentary synbolic logic, at t'le undcr'^rac'ua te level, u^-^^^ 
Computer Assisted Learning (CAL) . 

The project, as it is presently conntitutcd, cons.Ir>t« the 
work of the author, as described herei;;. 

Uhen completed the packaj^e v;ill allor student'^ to lonrn all the 
elements of logic at a computer terminal. This will alio*- tc:ic] orr. 
to leave the learr.inp of the fornal nanipulat lonr. mwoIvc:! in t'\e 
proof procedure to be done outside of lectures. 

As this paper is being written the project -r-escrll:ad apDroac'-ar. 
completion and it is anticipated that the first classe55 to ur,n it 
vrlll do so in the academic year of 1972-73. 
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It has lonr, been the belief of the author of this -aper t>at HAT 
is headed away fron the type of conventional .lesson -.ro'lucoc^ in thn 
last decade. On e of the chief cliaractarir.tic*? of th\(^. type of 
F.ateri^il has been that the conputer !mf5 lar,:^ely rjia^red a "nu^st^.on 
asking " role. In this role it has not been calle^^ on to use nuch o'f 
its problem solving abilities. 

Typically, instead, it has asked questions, and based on the 
results of analysing the student's answer has decided vho.t ^urt'^er 
questions to ash. The only place vhere it has to use ^tr. 
capabilities at all is in analysing; the student's ansner. *'hila tV±s 
is an important ability to be have (i.e. response analysis) typically 
it does not demand very riuch of the computer. In fact :U' car»not 
demand very much of the computer because the analysis viust ho very 
rapid in order to allovr for many such analyses to he carr-!e<' out in 
as short a time span as possible. 

The result of this trend has been that the chief duty of t^^e 
computer has been a.s a text handlinu system "hich ^ust select^velv 
print out, for the student at his terminal, var-'.nm r.assa'^os 
dcpendinn on how he ansvrers questions fron tinFi to tiro. 

I choose to call such a system a "papo ttirn" 'In^ rystem. One 
of the most important characteristics o'^ the "parre turners" is t^^at 
by their very definition they cannot encom.pa<;s vorv nuch ^l<»:.:ibil ty. 
In lessons of this tyne one measure o^ the sorhistic^.t -^'on, and of rhe 
worth, of the lesson is the number different stu-::^nt responser. 
that the instructors anticipate and nrovide for. ^-ost s^stc^r. 
provide for automatic collection of unant jc^natnc*. re?r'0'ise'3 in or-.^r^r 
to allow the authors to improve the oerf orrriance t'^e lessens at a 
later date. 

Ho\7ever ^in any sucli lesson it is cle^r that only a ''5n-:.t'^, 1n^' 
very snail, ^number of possible nnsTTcrs cnr ^e antic :I '^a t^'' . 
T^urthermore , even If riore rnsx^nrs car he ant ■'ci'^atcr' , after a very 
short time the point of ^diminishinp; returns is reached , heyonri ^-^. t c^- 
it is no longer *'orthwhile, in i>ome ^^ense, to ,^rovide '^or rci-c 
possibilities. This in itsell Is an objection to "pare tur/^n--" 
systems. It can be seen that It p.a':es them relatively in^lr^:- • ^- Ic . 

There is an even I'ore rlr.portant objection. In ront sub.'oct" t-^e 
most important thinf^ t'lat a stud.:»nt Iftarns is ' o^r to toIvo a 
particular type o.C nroMen, ;hcthev the ^ro' len is tran^^^laty n- '"ton 
one lanr.uaj^n to. anotlier, or Einishinr a xvxt' o-^atical nroo^. in 
learninf* to solve »^rnl>leTis the 5:t?r.lent i.eec'r, a ^:reat dea** of 
individual assistance f'roin *3oneonc relatively s-illcd in t^e 
discipline that he is learnin.'^,. It is at t^'is -^oint that '•o<^»t 
instructors hope t!-.at tlie computer, and CM , rJIl of r^one 

assistance to them. The computer, to he most ure'iul, <5hould he .h^ lo 
to fill the role of a tutor <^ho heln^ the student solve prohlcr?: in 
the field in vrhich lie (the r>tudnnt) is interested. 
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Unfortunately uith "na^e turners" ir <l I Vi, ^''^ class. 

possible to j.Tiii ^L^:.^ir':i..j^vJirt':r 

of CAI. fjenernl advance In the field 

b. independent' of the i^lll'll^ ^J^i one'^i:'^ tV.^'-^' f f 
course, not true of aJl oroofs nn» «^ C ■°» 

mathenatics that nakes it ll' "h.J. , a ^'^^^^'^ctorlstics or 
described above) is ?hat lt\« ,°oTt indenendent" (in the ner.ss 

svsten, f tieliberately constructed t'nt f'e 

possible ?hL ?f ,ot% ' "-r^^"" "'^''^^^ nt?^./-.,: 
pussiDxe, inis is not true ^or Avr»r^f 'Mo««4tsi4^^ ^ 
branches of nathenatics . ^ ^Usciplinc. or evo.n for nil 

r^^tu^lLi ""^"^ express the substance of n dJnc-.Jfn-^ in 

terns then ^1^*'%^ J"/-" '^^"1. ^>ut .till %a.ls -n loL "e.t" 
cerns then the riaterial would be less "basis .IcPnd'Mit: '' iinh i- , i 

noTh^^rL"!' '"/^'^ explained L i ^n-o' '.oui; 

not have to depend on the student's viewpoint. . ^ ou^a 

Many subjects, includinp nost of the science, arr verv "eivllv 
inJ^Iv^d' ?n -re important .uch'of t^e 'nn e^al 

Jy doin. this T ^e expressed in nathenatical t«n': 

independent- In th."" ""'l'" uJ?"" subjects nuch nore -basi 
arguments in* til J, °^ PhUosphy, if one expresses all of. the 

a^fnm^n;! syr^bolism of prepositional calculuc thrn the 

«ftem«nt: or\/f^T"'' '^^^l^^ "^-^^^ seoaraJely fron t^e 

statements of which they are composed. In this nay one can din.o«e I 
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of part of the problen of attempting to throve the correctn<»ss o^ a 
particular argunent by reducing the nroblen rlec^^d^'n- vhethcr \r 

not certain statenents are true. 

Unfortunately this reduction is not always a ni->nl if icat or Uit 
in many^ cases it is. Thus for students it can '-.elp theni see t'le 
truth or falsity of a particular arRutnent and t^.e conclusions rlra^n 
from iti 

In any case the last few parapraphs -ere juf?t an ^ntercTtMx- 
aside. , The point brought out in the?? is thnt tho conputer can be 
used in. one half of the process described abov-'. Thenrocos^ 
involved deciding if a particular ar-unent and the concltis^on^ 
involved were true. Ue can, then, divide the dccij^ion ra'rin?; proccjjs 
into two parts which can be nade quite distinct. The first step is 
to decide if the argument, nua argument, is correct. This can be 
done, in nany cases, with the help of the comnuter. Then i^ is 
necessary to decide if the statements of which the arirurient 
composed are true. This can not always be done with the help of the 
computer, and in most cases probably cannot be done at all by or with 
the computer. The second step is also comnlicated by the fact tl^at 
it is not always soluble. 



This paper describes one system for helping student?? decid(> if a 
particular argument is true or not. It is important to remember t?^at 
the argument is considered, as an argument, abstracted from 
of any of its constituent statements. Thus tbc» 



the truth 
developed 



, , programs ....v^,^^,.^^ , 

considered as lessons, are relatively *'basis independent*'. Thu*: if 
t;xe d is any "brain washing" going on it is, essentiallv, bein- done 
dx^ectly by the teacher, and not by the computer. ^'oro important the 
lessons are applicable to all student.? and not jiust those t^iti> a 
particular point of view. 



The discipline for which the nachafte j 5t intended is synobllc 
logic. I do not call it bv the more t^eneral nar»c "^roposit ional 
Calculus, or Predicate Calculus because the nvstor considered does 
not contain any quantifiers. 



The purpose 
"mechanics" 



of the system is to hclo the student learn c'lc 



of the proof procedure involved in symoMic logic. 



For many years symbolic logic bas beep di^ ^icult to tcocV 
succesfully. The problem, basically, is t'-nt t^e stu'^rnt;., 
particularly those ^^ithout any mathematical ponhirt icn t on , aro "It 
familiar with the type of thought required in order to be aMe 
succesfully to understand the elements of logic. ^Miot tUoy need r-oro 
than anything else is opportunities to engage l.n • n.lent.-J '"ut r-rnc*: 
with the help of someone familiar \'ith the nu^j^ct Mn t ''^ri;*.! . 



Ideally this would mean that a tutor \-nuld sit '^o^m rit'^ enc?» 
student and help him in doing proofs. The tutor voni/.: cr it::.5i-f r: ?. 
students proof s as he was doing ther. and x:ou3'i continue to ' c.l:? ^.r- 
this way until he v;as satisfied that the student unclor s too/ t'-e 
material well enough to continue on his o\m. 
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Actually the rtituntion outlined al>ove f.R the ider.l Jor Moarly 
all subjects and disciplines. Unfortunately it if: not roal'J^eci in 
very rianv, if anVt subjects. The rest important :V.f ference ^ct 'f»Gr. 
synoMic loric and ot^i?r subjects is t^:at the 53tadcnts nither can't 
or won't learn the subject in any other ray. This is 3upt>ortol >v 
the f net t!iat rxost students consider Ic^ic to he an e::tr ^^ O.y 
difficult subject and that few of then really are able to do avor the 
fornal manipulations involved in the proo^ nrocedure succes^ullv^ ?.ot 
alone, really understand the basic ideas behiuf^ t>^ese nmipixlat J.on:-.. 

If I nij^bt hazard a ytuess as to why this is the case it ni'^*'.t -^e 
due to the fact that nost beginninj^ university sutdents arc not used 
to the self discipline and constant study and practice involve*- .»n 
learnins nathenatically related subjects. Hven "pure r:atl-or^atics" is 
a problem oriented discipline in which the novice learns by do-^r^t 
problems. Thus because they do not have, or realise that they need, 
the self diccpline required to learn lotxic they do not nastor tbr. 
subject successfully. 

However one should not be too quick to apportion all the Mamc. 
Lo the students. The learning of the ability to do problcns is not a 
subject amenable to lecture treatment and this is a lar<^e 
contributory factor to the low success rate in true understanding of 
the concepts of lo,9;ic. 

The packap;e described, then, "sinulates", after a fat;blon, a 
tutor for symbolic lotric. It is meant to fulfill the needs d<.'?5cr?bed 
above. 

ITe expect that it will be used, in its first complete vnr «:ion, 
this year. 

The remainder of the paper is devoted to doncriMn'* tbo •>ac'--a'?e 
itself. Few technical details about the prorrr\^»f^ aro ^,±von sliico 
these would needlessly obscure the concerts nn.'- :rinc!nlcr^ 
operation e;:plained. Further details are availabln "^ron tho, nut'ior 
on request. 
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This section is devoted to explninin^^ t^o :iacV.n'>.^ n<5 tho ntu^ont 
sees it trhcn ha sitr; Aovn nt n connuter terni np. J. • ^ 



The terninal .1 tself ±s an IP*'- 27 AT tyncvr iter tornlnal, 
?hysic*'\lly it is sir.ilar to an I^*' selnctrlc cpr-fcn f v-pcr Ito^, In 
principle, however, any terninal T7hic?> is snni>ortn:l by the A?L svj?tc^ 
can be used. Vhile, at nresent, this ror>renerts a ^airlv li'^ito.d net 
of. terminals the situation is rapidly innrovin'*. 

The student can type in ansvers and nnostions, an <*.er?criled 

belot;, and the computer can read rhat he types. The cor/^utor cap, 

also, type out whatever it lll.es at t1*o type\?riter Tor the student to 

read. Thus a "conversation" can he carried out. 

Let's assune, for the -•onent, nh.-rt the stu^lo^t '«an n oucst-^on no 
ask. Since tbe pac]:ar:e in r*»stricted to sy^nholJ.c lo*^».c t^^e nuost-^.on 
Tnust he expressed in the "lanr.uafte" of symbolic lofjic. This ncans 
that the question nnst he in the forn oC a theorem to !:e nrovon. 



The student sits at t!ic tcrr.f.nal and identi^Aen ^i:i:-clT i:o t'^e 
computer. This is just a formality -vhich he nun t "o t'lrnu'-h In orc-?r 
to use tlie conputer and to 7,ct the teachnre Unov -'ho is us?.n ' uVe 
projjrams. 



\\a can then type in the theorem. At t'. f'? poJnn there r^.vt^ jL**o 
possiblities • The student mny alrea'i^* have a "^roo^ "h Ich "^ntr. 
the conputer to "look" at; or the student ray rot -^e a'-^le 1:0 do c'^e 
proof and grants some help from the connuter. 

In either case he henins to type in as -^uc!: 0^ the proo'; an ho 
knous. As he types each line the computer loo!-n at it. If tho l?no 
is correct the computer allows the student to continun, If the l^.ne 
is Incorrect the comnuter attempts to help the student. 

In order to understand better hn\r it V.elon the .«;ttidc-n t lot nr. 
consider for a moment what a line in tlie prco*" nav loo' li'u:. !";!cb 
line consists of a formula, expressed J.n t!io f;yn'ol ^ s^* of ';vMho3 tc 
lor.ic, and of a justification vhlch is sunponcil to er-'Oa'fn "h*^ the 
line is there. 



ERLC 



If the line is correct then thin r:enn<5 t'-at only the 
justification is incorrect. This !>ay he due to one of two reanons;. 
The justifications may be incorrect due to the ^act t!uit the student 
has left out several lines in the proof. Or t^^e justification r.ay he 
totally in error. 

nirilarly the formula may be correct, and t«'e junt if icat iou also 
correct, but the student may be lioadin'' in the wronr c'.trection. 

Finally the form^ila may be totally "wron^": it -^ay not ^e a 
valid formula, or it may not he derivable fron thrt ^recedin'* lines. 
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In each of the above cases the connutftr attfV'tT. 
o<; askinp the student questions, to shot? !)iv» vhere '*<^. '•ron'*» 7n 
the case that the student is ^oin^^ in {:\z '-ron*^ '^JroctJ.nn tba 
computer allows hi^n to continue until ho, "orU;; hi'^ ••ny into a 'V^c*: d 
end" and then points out -to bin hy as!:ii\-: •-'Ufrfjt :* o^^s i^oui: .-ac*^ 

the various directions in whic!i he contJ.nu^ ••1:y ho cn::not r'^.nc^ 

the n^-^^l* Then it shovs hin v?herc to :-o '.vicl; to. 

If bis line is totally wron<; ;.t re^'icvr; thr*. ro.l:?va\t o'" 
the lofjic with hin tintil he Hinds vhore his :'i<ta!.e fs. 

It proceeds in a similar tianner in each n^l t*;o ro^-^a Inin'* c : :c5. 

It nay happen that in the process of a^i!'?n- thct stu'li'^nt 
questions the conputer decides that there In ^. 'lundcT'ontr.l 
misunderstanding; of a concept. Tn such a case the co'^nntftr '-ill .^r.-..' 
the student to see one of the instructors of th^ course. 

Until this point vc have - assuncd t^nt tlie sttident '-us n 
question, in the forn of a theorem, to ask a!o*it, O^ter, !^o*'0'vc:r , 
tlie student does not know what questions to as':. In «;uc!: n c?irc t'»c 
conputer will ask hin questions and help liim solve the^. 

The computer nust havA oomt indication of !iis ^^^H^t^^^ nr.?^ t;'-^s 
can be f^ained by ns!:inr him what rules of inference t':o to'^-'cal 

systen he is fanilirr with. 

Then as the sttident ansTJcrs t'le quantion*; no-jo'', ! *" Mr\":o? '^r 
the conputer, the cor^nuter can ohserv*^ t»hJc> rtil'^.r. 5n'*or'*nc^ *»e 

has trouble deal?nr^ with and corcer.trato. rore *\cni»"f,ly on r*\r^'%t^ o'a:\ 
denlinfj with those ^articular rnl'^<! inrcrenc<>, r/ op t:-*^. r^r'-'^r^ , 
whf;n asked to nose questi.ons^ Thur. tho. co'-^nvtcr r.r:«* ro!*c ".a t rate r** 
the students weak points. 

At this point it will be seen that the systc-*, ••Ui..'^t\cn 
ansv;erin{j system, is complete, J.t can an^^vor ^Micr-tion?: 'sil^n 
any theorcM in symbolic locjic with ccr'c.-.in r:it'*-:%* arbrtrnr;', ^ 
adjustable, restrictions on the length of the ^ormulm '<oalt -'it' , 

In addition the packape can hel^ t^^e i;tudci:t hc^L.i 'y ;ro:-';i- 
questions which will r»oreover he dined at his i)vn '!? f f icult"? cs , 

ilach i«s^ructo^ must now couplenent the pacha^.o x.'f.t*- i**-^ e. 
convent iona.l lessons of his own. These (^eal with t'*'^ --^oro ''or'^-^! 
definitions wliich the student n:ust learn before ':c can ' c In '!o*p- 
proofs. A i>acka."o. or lessons is provided, norc for t-i*? « r o r''" 
completeness, than Tor any other reason, and is sel^ ^:u f j c-^ cut • 1^ 
any Instructor does not like the treatment he can, --iii'^ very lltfc.l-! 
effort, write his ovn set of lessons to ':o aloni* *rith the nuo*-t*o'; 
answer in;*, sys tem, 

""tote that the type of question that the studout '•^•>-' a:;'- J i^ nu-^'te 
general. If he is, for example, havinj-^ di*^ficnltv ^•ii:'« one 
particular step in a proof :;e can exnress this step as a t'-eor'^'* 'cn 
be proven and thus ask the conpr*"er to help hin. 
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The actual notation xise<^ ±n tan S;/nholJ.c Ic-.c car. ^i-c-c 
Tuo forns are possible: Polish; and Infi::. In ■,>ol:-..'^'t notation" ••t .:o 
knov? as "Prefi::" notation, operators alr^avs occu>- to t*^a 
their operands. In infix notation operatorn ' alr-^r^^s occu- - -^.i 
their operands. The cheif advanta-^e ^ol::.^:\ not-tron »-'".-t 

brackets are not necessary and. for thi. reason it i-: -oro .^iV-^ t-* 
for uorh with the conputer. Infl:c notation, t-e oth'ir i- -^n 
easier to read and is nore conventional althon'^h :\t "on^i t^^-:u?r\- 
braclcets . 

In addition to bein;^ aMe to specify thr: tvnr* nornt^o - -ho 
instructor can also specify the characters to ' e use..' to ro •rc^o-^ 
the logical operators. Since the typehall on the tcr :i^ aJ. can c^nsii-- 
be chancred virtually any characters car. he :isc-l. The t-'nor.u"^l 
usually used for APL is nr.rticularly suitaMe ^ ecauric -^.t conti: T^l 
the characters used in nost textbooks to renrsnent t^^i oncrator'^. 
It, in fact, has all the characters wseo for r^ost oocr^t-'on.^ ?n^roi''r>*. 
in set theory and thus is a very satisfactory choice. 

In addition to specifying the characters to be use-:? to >-o->*^ret>t- 
the operators the instructors r-.ay also specify vhicT* onerator^ "''ill 
be available to the stude^it in I\is proof '-v suecif^'inr "hat rule-: 
inference nay be used* Thus th^ instructor" nay snecif^' particn^ 
lo-ical S3'Ste.TS (i.e. intuitionistic/class:? cal)l The nturTont 
only allowed to use the rule«? speciflnd in h-ff? -^rooHs. 

Finally the instructor ray specify the -»a->er: usel '"o^ '^ac' 
the rules of inference. This last is just a <TUo.stion taste 
will allow the proofs to conform to any particular ^ftirt usc-^ 
course . ' " 
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All of the programs are ^'ritten in \?L (A^ Frc-rnnK^^nf L.-.n-ua'^'O • 
As such they rnay be used on any cor^puter ^'hlcb supports Tn., '"l-c* 
only changes from systen to systein 'tquIU he ninor -.ftcaur-..-^ of J:' e 
uniformity of APL as a l-inguap^e. 

The complete package fits into one? APL vorU^i^ncc (32'-:-), 
accompanying lessons and the response analyses ^or t-ie oiif^pt r on*^ f'at 
the prorrrans ask the student xzhen he has cii^^f.cultlos are ^^jin^io:*' '-y 
programs from, a packar^e, tjritten in APL by tho. author, caller^ .'^^L/TAT 
(APL C^omputer A^ssisted T^eachlnp packar^e) wh:lc^' has been In -'••Ic^ n' P. 
for about one and a half years. 

The most important program in the packafte is a "T'^eoren Throve r" • 
This program can, given a theorem, produce a -^roo*" in a very sasily 
readable form. 

Each proof consists of separate lines. On each line in put one 
formula and its justification. The method of proo^ is that of 
subordinate proof, Fara^raphing is ncef^ to nal-e t-ie. sulorf^ilnate 
proofs easily distinguishable: each subordinate proof is inclentcc? 
tv70 spaces from, the "encompassing" proof. Ml the :]u5» ti^icat^ors 
form a column on the right of the proof. Each justification covnistr^ 
of one to three items. Always included is a rule ^y vhic'^ thz iter» 
may be justified. Then zero, one, or t^^o line numbers of •^r oc«f^ In'^ 
items which be involved in the justification are '"ivcrs -n?? "^^y he 

required , 

Each line is numbered in sequence ard a margin is left bet;7een 
the number and the item. In general the theore-> ^ef-n * _'ro\'el \f{ ret 
stated .at the top since it is alvrays tTie last l:'ne the proo*^. 

Actually the :.tudent never cor.sn into sli'»'oct contact ^'1^^ t'^e 
theorem prover. The program that he cop^^s into nost contact rit'^ 
the "proof checker". As he tynes in a proo- a line at a t±:\o it 
checks his proof to see if it is correct. Pircrt *t seas '.^ erc-^ lint?. 
is a "T7FF" (Uell Formed formula). Then it cbcc- to sec IF t^e 7.-?ne 
does indeed follow from the Tiven justification. 

If it does follow ^'rom the justification end Ir. a "'FT thev t'-xe 
student is allow to continue. If tl^e line is not p. "''^^ tlie profrnm 
helps the student analyse tlie c^:pressi.on he *ias ty^eu 5n, 
Essentially it analyses tlie expression vit^ charactor '^y 

character until he sees where his -i"? stake iu. 

If his line does not follow from the justification tlie thaoren 
prover is called. It is gi\yen the proof to date, vhic*? mu:;t he 
correct, since it lias been previously checT-.ea, arJ asked to att<!: pt 
to derive the student's line. If it can do so thew thft justi^^ication 
is in error but tihe formula is correct. If extra lines s^re required 
to derive the formula then the student has skipped over several 
steps. If the formula cannot be derived tlien the student has typed 
in an erroneous formula. 
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If the student cannot continue, because is un?ure !-.ot> to 
proceed, then the pro^^ram asks tbe theore-p prover ^-^hp.t the next If.nc 
should be and by vray of '^^uestions helps the student ^in.^ it. 

T^inally i-jhen the student finishes t^e -roof the nro-t^r/?- '-ills 
the theorer: prover to detemine i^ the proo*^ is as concise as ^t 
might be. If not the program helps the stuc^ent see »'hy ^t l<! not 
Generally if the proof is not as concise as It could he it r. ^^ocause 
the student vent In the vron<> direction l:or a -bile. ^'hen he either 
realised T^^hat had happened, or '^o t stuck ond r,ot heln fro- t'-'e 
computer. Thus the computer ensures that the otudpnt 1s a^vare that 
he went in the wrong direction for a ^rhile. 

There is a series of ^roftra-^s that serve as int^rfacc^ hettrepn 
the two proj^rams described above. These convert bef-^een tbe variou^ 
notations used internally, and those r^peclfled h-.T the ins truct .')r . 
The notation used by the Theorem T?rover is a -nodi^ied prefix (t5o3 1sM 
notation. . • •/ 

Another important component of the packa^^e ns the "Ouestior 
Asker". This program ^riH, on deTnand, ask the student a -luestion 
whica he can try. Uhen selectino; the .Tuestion the pro<>ra!r^ uses t^-o 
criteria. First it asks a question which only needs the rnle<^ o*' 
inference, that the student has said he knovsT to do.' Seco^-P.v 
every tine that the student maVes an error, in t>^e c^echer, thi-. is 
noted oy the computer alon'^ -Tith a note as to -^Ich rule'o^ 'n^ernnc^ 
is involved. The Asker then asks :aore questions about this rule o^ 
inference. The "more" useJ, previously, is a statistical "vore'\ 
The questions are "randomly" constructed In such z lanner t-at "t^e 
rules of inference that the student has iifficultv nit'^ are n-.:cGd 
about n;ore often than ct^iers. 

These, along vith i few sapoort pro-rams, cov-^rise the entire 
package. As was said the technical details will not he ixscusse-,. 
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A: ff7?':t'?roof 



Tlie package w.is constructeJ Ln 5;uch a ^-ay that, t'lc 
instructors specify polish notation, and npecify the character s usad 
in the games I-7FF'n'T>R00F, and the nanes of t'-'e -^-nles of inference 
used there, then the packa«?e can be used, in a ver:^ natural vray, to 
help teach the jjaiues* The students can ali>o t-ien use* the co-«Ti.nuter as 
a sort of referee for ^ames since it can prove thaore'n*^ ^rhen renuired 
to do so • 

It is almost certain, in addition, that t'.ie co*^.nutfir could :)lay 
the games vrith the student, and, indeed ," prortra'^.n are V.ein*^ vrftten 
to do thir.. 



B: OUTPUT OF PROOFS 



The package has been del'ibera t ely constructeu in such a -^anner 
that the proofs generated by the theo^en prnver ire never cutout to 
the student. This would correspond to "'^ivin*>" the ntndent the 
answer. Instead the other pro'^ratap in the ^acl'a^^e use the proofs 
j;cnerated to ask the student auestlons to h.elp hirr ^ind his 
difficulty. 

It is quite possible, however, to have proo^p output by t^o. 
program. Thus the theorem prover can he used '-y Itself, 1^ '^lef^re', 
to produce proofs of theoraias. 

C: DETCRMIMATIOH OF PEUFQTIMANCF rif STUPPTTTr- 

As was nentioned earlier the pac^^a.'^e uses the A^'f./'^AT pac'-r-e. 
This neans that the teacher nay select to trtonitor thr* stucontV^ 
performance to any dej^ree that he likes. He can also -monitor, hv t!ie 
sane token, the performance of the package. 



I): INDEPENDEHCE OF TEZT. 



In addition to the options mentioned above rhich the tencho.r nay 
change he can also change the questions which the corputer as!:s the 
student when he has difficulty. Thus the trpcher -ay naVo t* 
vpackage as indenpendent of any particular apnroi^ch as he nleasc^. 
Since the package fits comfortably irto f^. vorkspac.e there *^nv be 
several versions of it available at any ?,iven r^.o'-'ent ar?<? the students 
may select the one most appropriate to their •■)articular cource. 
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The term 'adaptive* is used to imply that the computer generates tasks to 
fit a pupil's competence, as well as supplying individual feedback and remedial 
exercises based on patterns of error. The system itself is given a representation or 
model of the task, builds up a student image from his performances, and has a series of 
teaching operations it can employ under the control of means-ends guidance rules. The 
teaching potential of such systems is much greater in certain contexts than those 
which use pre-stored material, but more precise information about task and student has 
to be uncovered through systematic experiment. These approaches have been developed at 
Leeds in Junior Mathematics and Medical Diagnosis. 

A series of experiments will be outlined. These investigate models of 
difficulty in some arithmetical an^ diagnostic tasks, and study how adjusting task 
difficulty to fit student competence, and varying type of feedback and remedial exercises, 
affect learning gradients. Also, in the medical area a computer based diagnostic game 
was devised to examine a student's strategies of choosing and processing information. 
These experiments suggested models and guidance rules to be used by the computer in its 
Adaptive teaching system. 

It is argued these systems not only have greater teaching potential but 
provide a general framework for systematic experiu^ent and theoretical discussion. 

LA CONCEPTION ET L'SVALUATION D'UN ^ .St£mE pgDAGOGIQUE ADAPTIF 



Le terme "adaptif" signifie que I'ordinateur propose un travail du ressort 
de I'el^ve tout en fabriquant des "boucles*' pour les reactions et des exercices de cor- 
rection bases sur des modules d'errcurs, Le syst^me lui-meme re^oit un module du 
travail et des exercices, reflate I'el&ve selon sa competence et dispose d'operations 
enseignantes qu'il peut employer selon des regies donnant les fins en fonction des 
rooyens, Le potentiel pedagogique de ces syst^mes est beaucoup plus grand dans certains 
domaines que le potentiel des machines se servant de donnees mises d'avance en memoire, 
mais des informations plus precises sur le travail S effectuer et sur I'el^ve doivent 
etre trouv^es ^ la suite d^experiences systematiques. C'est n le resultat de notre 
travail ^ Leeds en mathematiques pour les jeunes et en diagnostic medical. 

Nous allons decrire une serie d' experiences permettant d'etudier des modules 
de difficultes recontrees dans le diagnostic et en arithmetique, aussi d'adapter ces 
difficultes au niveau des el^vet et de faire varier le type de "boucle" et des exercices 
de correction affectant la vitesse S laquelle I'el^ve apprend. Nous avons aussi, dans 
le domaine medical, mis au point un jeu dit de diagnostic visant I determiner pourquoi 
et comment un el^ve choisit et traite 1 • information, Ces experiences nous ont amenes 
a definir des regies directrices et des mod^es que I'ordinateur doit utiliser dans son 
enseignement adapte. 

Certains avancent I'idee que ces svst^mes, non seulement or*: un plus grand 
potentiel d' enseignement, mais aussi foumisscnt un cadre general d' experimentation 
systematique et de discussion sui- le plan theorique. 
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1. INTRODUCTION ; THE GQAIS OF COMPUTER ASSISTED INSTRUCTION - 

The innovations of Educational Technology have been disappointixig 
in the sense that they have had only limited effects iipon educational 
practice. However, this does not appear to have blunted the 
enthusiasm of some workers in the field who tend to greet each new and 
e^nsive advance with the same over-optimistic htpes of achievement 
and benefit. (See illustrations by Hubinoff 1971. ) The reasons why 
these promises are not fulfilled do not lie within the nature of the 
innovations themselves. Educational Technology includes the pro- 
duction of material which is to be displayed ajid managed by devices, 
and^ it is clear that many other of its characteristics, for example, 
behavioural specifications of objectives, task analyses, and close 
monitoring and evaluation of responses, correspond to sound pedagogy. 
Oettinger (1970) gives his views as to the reason when he describes 
some characteristics of the practical teaching situation and the 
.administrative structure of education, its inertia and complexity, 
and the difficulties which must arise when aiiy new major technique 
has to be incorporated within it. No innovation in educational 
technology has made an explicit and determined attempt to solve this 
problem, although some projects which use the computer (e.g. 
Pittsburgh: Ticcit scheme, Texas) seem to be attempting partial 
solutions. However, in respect of SAI Oettinger' s viewpoint may 
not account for all the difficulties. 

The aim of 'institutionalising' the computer so that it plays an 
integral part in administration, teaching and research activities in 
ways which are cost-effective must be a long term aim. ^breover, 
many problems must be solved before this aim is realised. This 
realisation involves the development of large scale multi-access 
systems, computer and author languages, studies in curriculum develop- 
ment and much more precise experimentation in ways of controlling 
learning. It could be argued that the present state of knowledge in 
Bsychology and Computational Science make any aims of useful appli- 
cation of CAI unrealistic, and that resources would be better employed 
in \asing the computer as a laboratory for studying learning and for 
developing methods of representing S'budent performances and types of 
tasks. This argument (e.g. Clowes 1971) maintains that author 
languages are piumitive devices which necessitate all the educational 
reasoning and methods of decision making being carried out by experts 
prior to the teaching material being written. Until techniques have 
been developed by which the computer can take over this responsibility 
and manipulate knowledge structures using natural language communication 
which goes beyond keyword matching, the objectives and the learning 
gains made by students are likely to be limited, and will not justify 
the effort which has to be put into the production of educational 
material. 
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These argvunents have some force, and work in Artificial 
Intelligence, which is tackling these problems, could have 
beneficial and important effects on CAI. However, it is only by 
setting projects in practical teaching areas that the nature of the 
difficulties of managing learnixig will become evident. It is also 
clear that present facilities in communication and data collection 
do allow proper e3q)eriments to be carried out. Therefore, although 
the CAI project at Leeds was set up in 1969 by a three-year grant of 
£120, OCX) fl*om the Science Research Co\incil and the Social Science 
Research Council, and although the project was oriented to research 
rather than to provide service teaching, the long-term underlying 
aim has been a practical one, namely institutionalising the computer 
as a teaching device within a school and within 3ome university 
departments. 

The research moneys provided for staff and for the purchase of 
a small con5)uting system entirely dedicataid -to experiments in CAI. 
The system includes a Ifodular One computer with 16K fast store, a 
1M word disc and some 12 terminal stations which are teletypes and 
avidio-visual devices, some of whica are remotely connected through 
F^st Office linDS. The main en5)hasis of the research has been to 
develop adaptive teaching methods vhere * adaptive' is not used in 
the sense of merely providing different feedback comments or 
allocating students to different remedial material. It is used to 
indicate that the student is routed to different teaching approaches 
or that different tasks are put together as required on-line to fit 
a particular student^ s conpetence. 

There were several reasons for taking this approach. First, 
although limitations of the terminals restrict the communication 
between the student and the computer, the record keeping facilities 
and fast operating speeds which are available enable it to be a 
poworful decision maker. Provided that the representations of 
student perfoiTnances and tasks can be made in precise and quanti- 
tative terms, the computer itself can be used to develop a theory 
of instruction as a prescription of rules which specify the most 
effective ways of acquiring knowledge or skills. This e:q)erience 
can then be applied in oiv-line decision making, and should have a 
significant pay-off in terms of learning gains. Second, if the 
computer is to be used to supplement the work of the teacher in 
those applications where it is difficxiLt for him to give individual 
attention, adaptive methods, of the type defined above, are likely 
to be important. In this respect it seem© useful to distinguish 
between teaching functions of exposition, in which objectives stress 
acquisition of knowledge and its retention, practice , in which 
skills are repeated in context up to prescribed standards of 
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mastery, and what might be termed ^ problem solviiig ' in the sense 
that the material has some novelty and the student is expected to 
apply acquired knowledge and skills in a solution of his own 
devising In exposition, where objectives tend to be standardised 
over a whole class, or over smaller groups of students, other methods 
seem more appropriate • Our view has been that greater individueuLi- 
sation of control is needed in the latter two areas and these are the 
ones in which the computer can be enployed with great benefit. 
Finally, it seems sensible to tackle particular teaching areas in 
which conventional methods are meetirig with problems. For these 
reasons, work at Leeds has concentrated on the specific subject 
areas of: Junior School >fathematics (age 7-1 l), the teaching of 
English to immigrant children, Ifoiversity Chemistry, and Applied 
Statistics in the Social Sciences • These areas provided the 
computer with a range of different types of teaching problems, and 
also gave opportunity for providing useful supporting facilities of 
calculation and simulation. 



THE FRA^EWORK FOR ADAPTIVE TEACHING 

The aims of an adaptive teaching system stress the optimisation 
of instruction by relating teacliing methods to the type of learning 
task and profiles of students' performnnces. Almost ten years ago 
Smallwood (l962) showed how the computer, by stoidng student routes 
through a progrcun, could iise comparison methods to learn to guide 
new learners individually through the teaching. Although no 
evaluation of the gains of this adaptive programming was made, if 
the task is such that "models" of learning can be inferred from 
student performances (i.e» a quantitative estimate of the shate of 
the student can be made from performance, and the effect of teaching 
method on that state is known) optimal* decisions can be made 
(laubsch 1969: Van der Veer 1970). Tl^se schemes suggest a 
"problem solving" approach to the management of learning. Initially 
the student is in a learning state represented by pre-test infor- 
mation, and this has to be improved and altered to the state 
represented by program objectives. Vario^as teaching operations 
can be carried out which can analyse the task and set subgoals, 
sequence material in different \mys, and provide help and feedback 
on the basis of responses. Previous experience and performance 
profiles allow means-end guidance in the selection of these 
operations to be given continually. The components of this view 
of instruction are: 

(i) A representation of the task. 

(ii) A representation of the student and his performance. 
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(iii) A vocabulary of (teaching) operations, 
(iv) A pay-off matrix or set of means-end guidance rules. 

The representation of the teaching task must have two components. 
A ta^k analysis can indicate the ways in which content is arranged but 
in some areas, such as arithmetical practice tasks or medical diag- 
nosis which will be described later, rules can be given \Mch allow 
the compute]^ programs to generate material by choosing elements and 
composing them into a task. The second conponent is another set of 
rules by which the teaching programs can recognise different classes 
of task, for example by having measures which describe difficulty or 
complexity. This will enable equivalent tasks to be made vjp for 
practice, similar forms of the same task for giving wider e^q^erience, 
or more difficult or easier tasks to match against a pupil's com- 
petence. Mich of the representation of the student will be built 
up from on-line performance data, both to give general levels of 
competence and to allow specific hypotheses of types of error or 
misconceptions to bo tested. To allow the number of teaching 
decisions to be reduced to maaiageable proportions, the teaching 
operations should be hierarchically arranged. They include (i) the 
sequencing of tasks to provide a curriculum and within this (ii) the 
teaching mode, e.g. the broad method of control, whether directive 
or inquiry, within this (iii) the criterion level before heln or 
pronqpting is given, or remedial exercises stipulated and (iv) the 
type of feedback, prompting and help which are allowed. 

While the representation problems are difficult, there is a 
severe lack of knowledge about the means-ezids guidance rules. What 
is needed are experiments which will show the effects of the teaching 
operations on the learner's state. In some cases the models of 
learning will indicate which teaching presentation is necessarily 
optimal aver all students (Atkinson and Paulson V>70) but in general 
(and in the arithmetic and medical projects to be discussed later) 
these conclusions will differ over groups of students and the amoiant 
of time which is available for teaching. 

The advantage of this formulation of adaptive teaching is that 
it gives a framework for systematic experiment and for more^ precise 
descriptions of performance and learning. This will be illiistrated 
by referring to two specific projects, the management of practice 
tasks in Junior Arithmetic and ,at the tiniversity level, problem 
solving tasks in Applied Statistics and Practical Chemistry. 
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PR/iCTICE TilSKS IK JUMIOR iWHEMflTICS 



The experimen-os which will be discussed concern arithmetical 
calculations set in a vertical format. However, this material can 
be used in conjunction vdth other exercises which need application 
of, and give insight into, the properties of the numeration system. 
These take the form of gomes played at the computer terminal which 
have the children decompose and recompose numbers in ways which 
illustrate the ideas of place value, equality and associativity. 

Practice in computational skills has tended to be overshadowed 
by recent advances in other areas of elementary mathematics teaching. 
Nevertheless skill in conqputation is essential and such practice can 
be managed both economically and efficiently, and quickly shows 
significant improvement in performance (Woods et al. 1969). The 
Leeds programs have three features of interest. First, the com- 
puter keeps individual records which are accumulated during (past) 
sessions, together with a marker which indicates a pupil's present 
position in a lesson. A series of lessons (a lesson is a set of 
similar tasks) can be set against a student's name and he works 
through them \mtil specified criteria are met. Second, the com- 
puter ^^enerates lesson and remedial material. A lesson specifica- 
tion has parameters or constraints which determine the form and 
difficulty of the questions. These parameters may tie specified 
directly by the teacher, may be modified by using a library of 
stereotyped examples, or may be constructed by the computer tising 
'models' collected from previous performances. The numbers used in 
the questions are genei^ated randomly by the computer and filtered to 
these constraints. The sijnpler remedial questions are also 
generated but use ntambers which are based on particular errors the 
student has made. The third featxire of the Junior liithematics 
Program concerns the methods of conducting the teaching with pupils. 
In general, the question is printed on the teletype and the pupil 
types the digits he considers to be correct. Incorrect digits are 
not printed, instead a bell rings and he t ries again. Further 
errors produce feedback (of various typos) which is given to assist 
him to reach the correct answer. The criteria for moving between 
and mixing question types, and for entering remedial sequences can 
be specified by the teacher, for each pupil, or the computer can 
decide this by consulting its means-ends guidance rules. Th\is the 
teaching operations adapt in three ways, (i) By generating tasks 
which match a pupil's competence (ii) by providing different types 
of feedback and (iii) by generating remedial material. 

3.1 Mpdels of Task Diffic\altv 

A first set of experiments was to represent the task using 
hypothesized models of dif fic\ilty and to relate these to the actual 
levels of success which pupils showed in their working. The method 
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is geiieral for all tasks which can be represented as a sequence of 
operations* An error factor is associated with each of these and 
the probability of success can be equated to a polynomial in which 
the error factors appear as constants for the individual or /jroup of 
students coiisidered. For example, in considering the addition of 
a column of numbers (and ignoring in this illustration 'cariying' 
conditions) the model assumed the pupil xoxidertook a mental ordering 
corresponding to the natural number sequence. Addition of one to a 
number thus became a matter of moving a pointer (indicating the 
partial sum at that time) onqe along the sequence. Adding a general 
number to a partial sum therefore has three components: 

(i) The pointer is pre-set to a value equal to the number 
(the partial svm) held in memory 

(ii) The operation of moving the pointer is repeated a 
ntmiber of times which corresponds to the number 
to be added to the partial stmi 

(iii) The answer (the new partial stmi) is stored in memory 

This loop is repeated until there are no numbers left to add. Such 
a scheme is illustrated in Diagram 1 



1 £5)ub FHist Number 1 
j ^ Int o Store I 




DI/iGRAM 1. A model for the addition task. 
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The work of Suppes (Stippes 1967) gives some jiistjUcation for 
this approach, but if the model is developed and and represent 
error factors associated vdth 'pointer moving^ and 'storing and 
reading partial sums ' respectively, a formula for the total prob- 
abiHly of success of adding a column i? obtained. If certain 
assiunptions of independence betve^an opezations is made this reduces 
to: log p(s)/y/=! 8' log (l-E ) + log (l-Eg) where r^is the number of 
rows and s^the average number size. To validate the model, pairs 
of exercises, which had the same numbers set in exercises of 1 and 3 
columns were generated at 15 levels of difficulty. /ipproximately 
200 pupils worked through 240 exan5)les each (properly remdomised to 
control presentation and sequence effects) and comparisons were made 
between student ages, difficulty level and types of errors, xising 
analyses of variance and least squares curve fitting techniques. 
The data was extremely well ordered, gave support for the difficulty 
model and allowed estimates of error factors to be made for variotis 
student groups. These methods wre also extended to other numeric 
cal operations e. g, subtraction where several plausible models can 
be stipulated depending \xpon the strategy followed by a pupil. The 
methods of incorporating these models for use in generation of tasks 
which increase in "difficulty" as a learner becomes more coopeteiit 
have been described elsewhere (Woods & Hartley 1971), They use as 
a controlling parameter the probability of success at which 

it is stipulated the individual should work. The pupil represeiv 
tation thus includes his actual working level of success and his 
error factor estimates (Ei, etc) which are associated with the 
operations he is using in the calculations, 

3#2 Some Experiments in Adaptive Teaching 

Jxi ordBT to stTxtiy the effects of working at different rates of 
success an experimBnt was carried out in which pupils were raxxiooly 
allocated vc one of three treatment groups after being given a pre«- 
test. These groups had the difficulty of the questions altered so 
they worked at levels of siiccess 95% (high) 755^ (moderate) and 
60% (low). Post- tests were given at the conclusion of the treatment. 
Overall the results shov^ed a curvilinear relationship with the 
^moderate,* level grovp having the advantage in terms of speed and 
accuracy over the •high' level which in turn had a distinct advantage 
over the *low* group. A three-way analysis of variance using pre- 
test level, treatment groups, and difficulty of item in the post-test 
as factors showed finer differences. Significant interactions 
ix^cated that treatment level had meet effect on those low on pre- 
test scores, i.e. the less able were more sensitive to differences in 
treatment. 

The second method of adaptation concerned the lype of feedback 
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which cc^'id be given to pupils. Knowledge of results is usually 
held to be important in learning, although naiy ejcperiments have 
not succeeded in demonstrating its beneficial effects. An eaqwri- 
Bent was undertaken in which all gro>^ worted at the conputer. 
The difficulty levela of the questions were controlled, but the 
treataents varied on feedback conditions. The exercises involved 
multiplication of a 3 digit number by a single digit. In one group 
no information was given other than at the end of the session the 
pupilfl were told how many questions they had correct. A second 
group had 'passive' feedback, so tlwit if a second attempt at a res- 
ponse was incorrect the correct working was printed out. A tlxird 
group worked with 'active' feedback in which a sequence of questions 
and answers broke down and ej5)lained th& steps involved, "Tk pxpil 
then repeated the question again. This lost condition enabled the 
sources cf pupil errors to be diagnosed and classed as 'memory over- 
load', process, transposition, and conceptual errors. 

Liitially the pupils were given a pre-test, randomly allocated 
to treatment fjroups and after six working sessions of fifteen minutes 
given a post-test. The results were moderately encouraging. 
Briefly, the trends were in the predicted direction end the overall 
effect was significant. . The no feedback groxxp had no improve- 
ment at all, the 'passive' feedback group were better, and the 
•active' feedback group scored highest. The experiment seemed to 
suggest that for low performers 'active' feedback is best, and the 
more detailed error analysis which this gives can indicate the 
appropriate type of remedial exercise. As a person becomes more 
proficient passive feedback is probably sufficient and this allows 
more queationa to be completed in the same tiwe. More precise 
e:q>eriments relati»)g to the effectiveness of feedback are now in 
progress. 

The computer programs allrw hypotheses about types of error to 
be tested on-line. Associated with each hypothesis is a test 
routine which processes each response a student makes. The results 
become part of the student representation. Also the numbers with 
which errors have been made are stored. This information indicates 
the need for particular types of remedial e^rarcdees. i. sojmlo 
experiment with multiplication tasks set in vertical format was 
carried out to see if persistent process errors coiOd be eradicufj*'' 
by generating remedial questions based on his errors. (A persistent 
error is one in which an incorrect response is given to tho same 
question on several occasions. ) The difficulty level of questions 
was again controlled and there were two treatment groups - with and 
without the remedial facility. Depending on the frequency of a 
pupil's errors the remedial exercises wore interspersed in the n»in 
practice sequence. Examination of on-line error analyses showed 
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a successful result with the remedial group having a much lower pro- 
portion of persistent errors after six fifteeiv-minute working 
sessions, but the actual number of persistent errors was few. 

. The re,3ults of these experiments give some useful guidance rules 
smd these are being integrated into a faUy adaptive teaching system. 
This cannot be considered as a self improving system (beyond refining 
the accuracy of its estimates as more data is accumulated) siiice it 
does not alter its teaching strategy for the individual if perfor- 
mance expectations are not fulfilled. This is for future develop- 
nent. During the last sijc months the package has. been used by 
teachers, and integrated within the classroom. This is inportant 
because these programs merely guide practice using operations and 
concepts which have been taught previously. I>foreover studies 
(iibramson et al. 1970) show much benefit is lost if close reference 
IS not made between computer and teacher. The work et leeds first 
used the package diagnoetically, to provide the teacher with perfor- 
mance standards of individual children; thea it was used in para3i 
wxth new teaching, and finally it was used for revision. The 
teacher set down the performance standards he would noniBlly expect 
at the end of one year, and in fact these were accomplished in a 
littlfi over three months. Therefore, although this control of 
practice might be educationally Uratod, it can be a significant helo 
to the teacher, " 

I 

PROBIEM SOLVING TASKS I N APPLIED STATISTICS AND PHYSICAL CHEMISTRY 

The previous illustrations in mathematics although allowing the 
computer programs to take a greater part in decision makincr and to 
generate material when it is required, are educationajy small. - 
However, for many areas of the curriculum which are more prominent 
in teaching but which are less well structured, it is much more 
difficult to develop adaptive methods. At Leeds we have become 
interested in two such areas at the university l-vel, namely teaching 
students to plan and execute practical ejqxsriments in Physical 
Chemistry and Statistical problems in the Social Sciences. Both 
these tests are similar in that they involve relational types of 
problems in which a dependent variable is a function of a set of 
independent variables. In some exercises the students have to 
establish the effects of the -iiiiependent variables, and in others 
establish the particular function which relates then to the deDer.dent 
"vanabls. 

The practical difficulties of teaching Applied Statistics are 
weU known and much discussed. The classes tend to be large, there 
are wide differences in the students' previous mathematical eraerinoB 
and maiy of them feel unenthusiastic when asked to work in 
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quantitative and abstract terns. Practical Chenistiy has its 
difficulties too. Mich time is spent in the laboratory, but the rota 
method of organisation laoans that the theoretical work of the lecture 
room is difficult to synchronise with the practicals. The instruc- 
tions given to students tend to be detailed and directive and do not 
specifically teach the student to plan his work. 

Over the last twelve months we have used the coc^Juter to help 
second year Chemistry undergraduates to plan their experiments. 
After fomulAting their plans, they collect date by using. chemical 
apparatus, but in Statistics where similar methods are followed, the 
collection of data is done by using simulation techniques. An 
elementary analysis of these nlamiin;> +.nsk^ niakes distinctions between 
U; a planning algorithm or procedure which has four parts: setting 
the goal, the design of methods of data collection, the treatment of 
data, and contingency planning, (ii) the (student's) knowledge of 
the sxibject ana the operations which are involved in executing the 
plan, and (ixx) the application of the planning algorithm to the 
Utudent»s} knowledge base to solve the particular problem in hand 
The teaching material is pre-stored and is written using an author 
-language. It follows the distiriCtions outlined above and can be 
adaptive in the choice of overall teaching strategy, the anount of 
help, and the partictOar remedial sequences which are given. 

A. 1 The Teaching ffethoda 

teaching operationa have two general features of interest 
FiMt, there is the development of teaching strategies which put 
different amounts and types of control on the student. In the 
. strand' method the computer t^ways leads, and, depending on progress, 
moves the student periodically between small, medium and large step 
strands'. In the 'file' method, the teaching control follows a 
mxed initiative pattern. Information (on planning, facts, apparatus 
details and defuntions) is stored in files which are structuredand 
from which the student can collect the information he feels he needs. 
hb.thin certain linits there is free movement between files but 
finally the student must enter a check file to ensure his plim ^ets 
certain specifications. In the check file the computer assumes cont- 
plBte control, r^ external files can be consulted, and if progress is 
not satisfactory the student is routed to the appropriate sections of 
planning or given remedial instruction. The structure of the program 
IS .shown in Diagram 2. The supposed advantage of the file system of 
teaching is that it requires the student himself to decide which 
infonaation or type of help he needs and so he must continually 
evalmte his progress and analyse his difficulties. The adaptive 
teaching system should move a student between these teaching modes 



-263- 






DIAGRAM 2 

The structure of the computer based teaching pro/rrams. 



selectively fade the help he can obtain from the files, and also 
present kun wxth a proper sequence of problem solving tasks The 
information for this decision making depends heavily on the rep- 
reseirtation of the student through his performances, and throuS 
hypotheses which the conputer builds up about his knowledge of the 
a^HcatSr* P^^^^^ algorithm and his competence i^ its 

The second feature of the teaching is the use of simLLition 
pa.7ticularly in Statistics, where a simulated statis- 
tical laboratory has been developed. This suite of computer 
prograns gives the student facilities for setting up population 
parameters, for having samples dra-^ ft-om them wMch he^ edit, 
and for having specified calculations carried out on data. For 

^^Jf'J^ I?* "^^^ *° °^ population para- 

meters at the teletype. The computer asks if thrrequired Sstri 
bution is standard (e.g. Normal, Sinoaial, RectanguS^fSd S 
the particular profile has to be typed, u^lly SlerL^ SaS ' 

f i!?T^ """^ frequencies. Properly entered 'popu- 
lations' are laberUd and tho name printed out for the studcntC 
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reference. The subprogram DATA allows samples to be generated from 
these 'populations The saiaple data is labelled and stored but the 
student can also type in his own set of data if he so wishes. If he 
needs to remind himself of the population specifications, or enquire 
about particular sample values, or the amount of store which is left, 
he can do this by calling the OUTPUT program. One version of the 
program allows the teacher to set up populations to which the student 
cannot have direct access. Sanqples can be drawn in the usual way, 
and the other facilities are available. This allows data from spe-- 
cific research projects to be taken from the literature and used in 
the student problems. An example is the investigation carried out 
by a Research Unit into the convenience of differently numbered sides 
for the new 50p piece, which was needed when Britain adopted a decimal 
currency. 

Aji important part of the statistical laboratory is the calculation 
facilities which are provided. The student can have arithnetical 
operations carried out on each elenent of the samples he specifies, 
or have them operate on corresponding eleiaents betvreen pairs of sampLee. 
The saapls data can also be sunnarized as statistics of central ten.- 
dency, dispersion, order or class, and if these values are themselves 
set vp as labelled lists th^y can be recalled for calculatioriS to be 
carried out on them. Thus it is easy for the student to hvdJA up 
his own calculating programs. The package also allows usual numerical 
calculation and for arrays of formulae to be established in a file so 
that larger scale programs can be used more directly. Further, ther:: 
is an editing facility which allows sample lists to be merged, to be 
adjusted in size, or to be deleted from store. 

4-2 Some Experiments 

Experiaents have been carried out to study the effectiveness of 
the different teaching strategies, the improvements in student per- 
formances When a series of problems is worked through and the relation 
of these performances to other (university examination) measures of 
achievement. Two experiments in Chemistry will be briefly outlined, 
but those in Statistics have followed a similar pattern. 

In one study 36 students were randomly allocated to 4 treatment 
Cproups ((i) Theory - i.e. teaching of the knokledge of the Chemistry 
related to the Chemistry experiment - and Planning: (ii) Theory only: 
(iii; Teaching on Planning only: (iv) Neither Theory nor Plannrr^g) 
where students not having teaching by cocpiter used the normal labors- 
tory work-sheets. The ejqperiment followed ana?-ysis of variance "esi^ 
and post-tests were given on theoretical knowledge, planning a similar 
experiment, and planning an e:q)erinent set in a different area of 
Physical Chemistry. Briefly, both 'planning' and 'theory' showed 
significant effects, with these groups performing better th.-^.n the 
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work-sheet groups on the respective testa. However, the interaction 
between 'theory' and 'planning' did not reach significance, and dif- 
ferences between groups were much reduced on the 'planning a different 
experiment' test. ^ ^xcxau. 

A second e^^erinent conparod the relative iaorits of the 'strand' 
and 'file' systeas. It was thought that initially students would 
benefit fron close direction (strand syston) but as they becone more 
experienced they shouOd form a plan theas.,aves and collect the infor- 
mation they need to help then. This is best acconplished through a 
file system (informtion and pliinning files). Eventually thesrholp 
facilities shoula themselves be faded (information files only) 
Students were randoniy allocated to three such treatiaent group^ with 
the same material being used in each treatment, but differently 
organised on the file or strand systems. In order not to penalise 
the infomation files only' group, a check file was put in^this 
led to further remedial teaching where necessary. The results were 
as expected for these new groups of students. The directed (strand) 
method resulted in significantly higher post-test scores than the 
fxlB system, which also required longer time. The on-line working 
gave useful descriptive information on pattei-ns and types of error 
and performances on the check files showed the 'information fil^ 
only' to be the inferior treatment. 



Conclusion 

C]£arly much work has to be done before teaching systems which 
are adaptive m the sense defined in the earHer sections, can be 
fully iraplfiraented for teaching tasks of this complexity. No author 
language system presently in use has sufficient facilities or seems 
suitable in structure. Further, more detailed and careful indenti- 
fication of knowledge structures and operations, and more experimen- 
tation to determine means-ends guidance rules are also essential. 
However I believe that, in the long term, considerable benefits will 
come from having the computer take a more intelligent role ■'•i the 
on-line management of learning, and this line of research should be 
pvirsued strongly. 

These developments might well form an important ps ct of institu- 
tionalising the teriching activities of the computer, ai.d for a country 
with the limited financial resources of Britain a co-ordin:xted 

is needed. This must take into account and enjoy 
the benefits of reLited work in other countries. We need a coiL 

^"""^02° ^ °^ ^^"^^ "® '^^ properly meeting 
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APPROACHES TO THE DESIGN & PRODUCTION OF C.A.I. SEQUENCES SESSION 8A 

By/Par: J.F. Hart, R.L. Newkirk, J. Chapman, K. Judd , H, Mackenzie, ROOM/SALLE 143 
University of Western Ontario. 

The C.A.I, group at The University of Western Ontario has been looking at 
the problem of sequence development in the University environment. This practical 
problem, which seems to constitute a formidable obstacle to any future progress, consists 
of a number of related factors. Among others we recognize as severe imoedimcnts the 
vast amount of Lime required to write and test sequences, the inadec^uacy of methods of 
quality control, the difficulty of involving psychologists alongside physical scientists 
and mathematicians, and the lack of a suitable medium of exchange between sequence 
writers and curriculum planners. 

Taken together these problems appear to be a more formidable opposition 
to the development of tutorial C.A.I, programs than a lack of research in this type 
of educational technology: the research is in advanc* of the ability to carry out the 
development programs. 

In this paper we present the first results of a pilot project for the design 
of quality sequences. An experiment is described in which a group of students and a 
group of curriculum designers working in parallel developed a course on Elementary 
Statistics. The results were of two kinds. On the one hand, the experiment indicates 
the structure of an organization for the design of sequences which in part solves che 
current difficulties of C.A.I, development. Also, from investigations arising in 
connection with the joint working sessions of the sequence-writing and curriculum 
groups, some new directions are indicated including a method of global sequence ordering 
complementary to the local ordering methods associated with the matrices of Davies . 

SUR LA CONCEPTION ET LA REALISATION DE SEQUENCES POUR EAO 
(L'ENSEIGNEMENT A L' A IDE DE L'ORDINATEUR ) 

Le groupe s'interessant 2i I'cnseigneraent ^ I'aide d'ordinateurs I 
1 Universite de Western Ontario, etudie le problSme du developpement de sequences dans 
un milieu universitaire. Ce problSme pratique, qui semble constituer un obstacle 
formidable ^ tout progr^s d'avenir, comporte un nombrc de facteurs. Parmi d'autros, 
nous reconnaissons comme etant des empechcments serieux, la quantite enorme de temps 
nccessaire pour ecrire et verifier les sequences, 1' insuf f isance des methodes de 
controle de la qualite, la dlfficulte 2l amener des psychologues ^ travailler avec des 
physiciens et des raathematiciens et la manque de moyens appropries d'echanges de vue 
cntrc les auteurs de sequences et les planif icateurs de programme. 

Si on considSre tous ces problSmes, ils semblent poser un plus grand 
obstacle au developpement des programmes de T'EAO que la manque de recherches dan,^ 
ce donaine; la recherche est en avance sur les possibilites de mettre a execution les 
programmes de developpement. 

Dans notre communication, nous presentons les premiers resultats d'une etude 
pilote pour 1* elaboration de sequences de qualite. Nous decrivons une experience dans 
laquelle un groupe d'etudiants, travaillant en parallSle avec un groupe preparant les 
programraes, a dfiveloppe un cours de statistiques e] ementaires. On a constate deux 
sortes de resultats. D'une part. Inexperience nous porte vers la structure d'un 
organisme elaborant des sequences, ce qui resoudrait, en partle, les difficultcs 
actuelles du developpement de I'EAO. De plus, des resultats de recherches qui ont 
etc faites par suite de sessions de travail en commun, montrent de nouvelles oriontatjons 
parml lesquellcs une methode globale de classification des sequences complementant les 
methodes de classification locales a<;socices aux matrices de Davies. 
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1 . INTRODUCTION 



The research and development work in CAI at Western from 
the beginning has had as one of its goals, the production of 
lesson sequences which could be used for Compuv.er Science 
courses* 

With the gift of the coursewriter program from OISE 
(initially called FOCAL/CAN) the group was able to begin 
experiments in sequence design without a long period of lan- 
guage development* The first projects were done by graduate 
students who wrote sequences as part of the Masters thesis* 
The students accepted the idea, at least at the outset, that 
the writing of a large tutorial exercise was an acceptable 
part of research into CAI systems. Everyone in the field 
knows now the high cost of sequence writing, a fact which the 
graduate students soon recognized. But while they were still 
debating the issue and while we had some funds for summer 
students, we managed to write over 50 hours of sequences. 

We soon saw, however, that if we were to continue to 
develop sequences for use in the department and at the same 
time isolate less demanding projects for students, we would 
have to consider the problem of sequence design and produc- 
tion in its own right. Several unfortunate experiments had 
shown that sequence writing operations could fail, either 
because of insufficient drive on the part of the sequence 
writers or because the sequences (once produced) had little 
merit. Our ultimate objective became the production of 
sequences having an average lifetime, preferably in a commer- 
cial context, of three to five years, rather than sequences 
for experimental use. 

Our examination lead to the broad principles which we 
consider essential in a productive program. In general, we 
began to see the need for interdisciplinary co-operation which 
would involve specialists in course content, in pedagogical 
theory and in CAI technology, as well as a degree of student 
participation to infuse an acceptable dialect for the parti- 
cular sets of sequences. At the same time we recognized that 
universities could not continue in sequence production if 
costs continued to be high, if the development time was prohi- 
bitively long, and if the sequences were not able to pass 
certain criteria for quality control. It was an attempt to 
satisfy these requirements which lead to the experiment co be 
described. 



-270- 



student participation in the production of CAI seq.uences 
may be seen in the larger perspective of the development of a 
new educational technology. Programmed instructional sequences, 
whether for computing or print, must be written in such a way 
that chey are appropriate to the group which is to use them. 
Student sequence writers may contribute to the appropriate- 
ness of sequences by the vocabulary they use and the manner- 
m which they structure the course (Mager, 1961) . However, 
their J lexperience and unfamiliarity with the latest research 
may re^. t m sequences not meeting norms of professional 
competence and for this, it is necessary to have the consulta- 
tion of experts. On the other hand, it is not unusual to 
find that sequences written by someone knowledgeable in a sub- 
ject turn out to be completely unusable. The adaptation of 
sequences to the domains of both user and expert increases the 
time investment required, but may also result in greatly 
increased effectiveness. This gains in importance as CAI les- 
sons begin to be judged on their own merits, rather than as 
comparative improvements over previous teaching methods. 

This paper describes an experiment in which students were 
given the job of designing and writing sequences for elementary 
statistics. The purpose of the experiment was to see if they 
could do so in a way that offered the possibility of quality 
control during the writing process. If so, a new approach to 
CAI production [Hart et al , 1970], might be pursued. This 
approach requires that there exist alongside the sequence wri- 
ting group, a curriculum group with the required expertise in 
course content, pedagogy, and psychology. Essentially, the 
experiment consisted of the writing of three tutorial lessons 
for Introductory Statistics, using the basic facilities of a 
teletype terminal. The experiment was not concerned with the 
best hardware and software environment for design and produc- 
tion. It was cast on the wider perspective of considering 
organizational structure of sequence-writing groups in terms 
of the general requirements for production of quality sequences. 
The question was how to construct a CAI industry, making use 
of relatively untrained personnel with, however, some experience 
m the content to be programmed. Three students (chapman, 
Judd, and Mackenzie) were given the task of designing and pro- 
ducing sequences. The responsibility for writing the sequence 
was theirs, but they were asked to call upon the consulting 
group in various aspects of the work. 
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2. The Organization o f Sequence-Writing Groups 

The implementation of methods to establish quality 
control is basically an aspect of organizational structure. 
Starting with the organization chart of the agency engaged in 
production, studies are made of methods of improving the 
quality of the output. 

The problem is complex, but it can be seen in its 
essentials by looking at the way CAI has been developed. 
Until now, sequences have often been written by a teacher or 
by students under the direction of a teacher. The relation 
of the student in this situation is that of assistant, com- 
parable to that of a computer program coder to a systems 
analyst. In large projects, this structure can become 
strongly hierarchized, the apex of the decision tree being a 
curriculum group which in effect, controls all aspects of the 
work. If students are not to become mere clerical assist-^ 
ants, it is required to reconsider this way of operating from 
the viewpoint of the decision structure. 

In the study of Argyris [1964], the value of a particular 
decision structure is measured by the kinds of results which 
are expected to be obtained. A hierarchized structure is 
effective in certain situations sucn as when time is short or 
when decisions are of such a kind that they may be delegated 
to a leader with the consent of the group. On the other 
hand, a horizontal or democratic structure is applicable to 
situations such as those associated with the development of a 
new product or long-term planning. In the management of 
novelty, which is the case of CAI, the attribution of power 
IS along functional lines. The ability to originate actions 
IS given to an individual or a group in accordance with an 
ability to contribute to the solution of a problem. Argyris 
summarizes the guiding principle of decision structure as 
follows: 



We may conclude that organizations (of the fut ure) will 

tend to va'ry the structure t hat t hey use according to th e 

of decisions that must be made , if one asks the indi- 
vidual in the organization of the future to see the company 
organizational chart, he will be asked "For what type of 
decision?" 

The tyv^i of structure which we require for CAI is one in 
which ix student group is given power of decision in the writing 
of sequences, but which would also permit researchers to 
influence the design. The proposed organizational structure 
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consisted of two organically distinct working groups with 
separate functions. It was considered to be essential that 
there should be no relation of dominance but that the groups 
should work in parallel^ one to apply the general or formal 
principles of CAI design and the other to actually prepare 
lessons. 

The functions of the groups were not rigorously defined, 
since the operations of the groups were expected to change^ 
depending on deeper understanding of different aspects of 
sequence design. At this initial stage ^ work was divided 
from an operational standpoint between a curriculum group con- 
cerned with concept ordering and a sequence -writing group ^ 
concerned with the programming of sequences. The focus and 
language of the groups were different. The sequence group is 
concerned with a dialect appropriate to the age^ culture and 
intellectual background of the students, whereas the curri- 
culum group is concerned with a metalanguage of concept 
theories and pedagogical schemes. This difference in working 
language is closely associated with the relationship to 
specific techniques. The sequence writer must be versed in 
the technology of interactive computing, whereas members of 
the curriculum group are more likely to be concerned with 
techniques and theories in the psychology of learning. 

Assuming the existence of the two groups, a schematic 
must be designed so that the findings of both groups may be 
communicated to the common task. It must be simple and imme- 
diate and sufficiently permanent to allow the two groups to 
work at essentially different rhythms. A satisfactory link, 
described later on in the paper, adopted a technique similar 
to the clothboard in which individual concepts were repre- 
sented by a moveable set of cards. 



3. Strategies of Conceptual Ordering 

The ability of the curriculum group tw contribute to^ - 
sequence design, can only be on the basis of certain practical 
suggestions or strategies which it can contribute to the on- 
going process of sequence writing. Such strategies could be 
at the specific level of knowledge about a given field, but 
in order to be subject-independent and to act as overall 
engineering principles they must relate to organization of 
concepts in general, as well as to some specific field. 

General strategies of concept orderii.j may be divided 
into two kinds: those relating to microstructure or the 
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association of concepts in pairs/ and those relating to 
macrostructure of the global organization of the concept 
domain. In applying strategies cf the first kind, it is 
required to isolate the key concepts or rules of the material 
to be taught and to examine the relations of association or 
discrimination which exist between these key concepts. 
Eventually the concepts become grouped in clusters by tech- 
niques such as the matrices of Davies [Thomas et al, 1963]. 

The set of strategies based upon macrostructure are the 
outgrowth of research conducted by Denny [1970] , in the study 
of concept formation, in this analysis, the elements are, 
as in Davies, the individual key concepts, but examined 
according to the unifying aspects of a domain of knowledge 
considered as -a whole. The analysis is undertaken in the light 
of two closely related ^principles in General Systems. The 
first principle is that of system unity ; whether in fact a 
certain type of knowledge exists operationally in the mind as 
a unified whole. The second principle is that of system 
linkage , whether there exists a connecting link which brings 
together broad regions of a field and supplies an operational 
unity. The first principle helps to isolate separate or - 
nearly separate subsystems, whereas the second emphasizes the 
need to search out unifying schema or formulae. 

From these principles, the following strategies were 
provided by Denny, as a type of operational working hypothesis: 

1) Identify the conceptually distinct areas within the 
subject. 

2) Link concepts by means of their relations to more general 
concepts ^ 

3) Convey to the user at the outset the overarching genera- 
lization (Key general notion) of each content area. 

4) Combine secondary notions into an overall organization 
determined by the integral notion of the field. 

It might appear that the Davies and Denny strategies are 
essentially the same. The difference is that the Davies 
approach is from the inside out or from pair association 
toward the recognition of clusters in the larger organization 
whereas the Denny approach is from the outside in and conse- 
quently from the boundaries of the subject ittatter toward a 
definition of broad regional divisions and general linkages. 
The two approaches should_thus be complimentary and mutually 
correcting. In the work of the pilot group, only the Denny 
strategies were actually applied. 
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4. Formation of the Groups 

The curriculum group was readily established since in 
effect it existed already in the form of an association of 
university researchers interested in educational technology. 
The group included members witli backgrounds in media ^ psycho- 
logy of learning^ and concept formation. The sequence group 
was selected from a list of students who applied for simier 
work. The members of this group had backgrounds in social 
science, general studies cmd computer science. 

Prior to the selection of the students, it had been 
decided that the field to be used for the experiment would be 
Introductory Statistics. Knowledge of this field was required 
by members of the sequence-writing group. 

The division into two groups was not xigid - certain 
individuals might find that their occupations connected them 
more closely to one or the other, particularly if they were 
teachers , 

The two groups adopted quite different methods of 
working. The project was the students' continuous occupation 
for four months, whereas it was only onf- of a variety of 
university occupations for members of the curriculum group. 
Each group decided on its own procedures. Generally speaking 
the time limits for the completion of parts of the project, 
were primarily determined by the requirements of the sequence 
group, 

5, Communication Between Groups 

Since the curriculum and sequence-writing groups worked 
independently, an important consideration was the development 
of an effective means of communication between the two. 
groups, A graphical display of the subject matter organiza- 
tion was selected as the primary means of communication. As 
the project was housed in a separate room, the walls were 
used as a display surface for coloured cards. These cards 
contained a breakdown; first, into the two main areas of 
statistics (descriptive and infers! .tial ) ; then within each of 
these areas, into topics (e,g, regression analysis, analysis 
of variance) and finally within the topics, into component 
items. The topics were arranged in a proposed order of pre- 
sentation, and each topic was described by prescribing the 
items which were "entering behaviour", "intermediate lesson 
content", and "terminal behaviour" for that section. 
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This method of presentation allowed for effective 
conmiunication between the two groups. The representation 
involved only the concepts of statistics. The easy movement 
of cards contributed to a flexible approach to the organiza- 
tion^ both initially and during later revision. By means of 
the cards and their schematic relations^ all the relevant 
information could be conveyed to the curriculum g-roup at meet- 
ings convened for the purpose. The graphical representation 
also had merit in that it made clear visually structures of 
a type that are used in both- the systems approach and a con- 
ceptual organization of material and was particularly useful 
to the curriculum group. 

Eventually^ a computerized graphical display will 
provide a better method. The design of a 3uitable system 
will be facilitated by this initial experience involving cards. 

6. Division and Ordering of Concepts 

Before any lessons could be written, it was necessary to 
locate them within the field of statistics by doing a com- 
plete analysis of the subject and arranging it as an entire 
course in some detail. This was done in two steps by the 
sequence group. First, an exhaustive summary was made of the 
topics which were felt to comprise the subject "Introductory 
Statistics", and the component items in each of these topics. 
This was done primarily by reference to traditional textbooks, 
course summaries, etc. Second, the traditional organizations 
of tnese topics into complete courses was examined critcally 
and an organization was derived from this and from a study of 
prerequisites and relationships among the topics. In this 
organization, the group was influenced by their experiences 
in the study and use of statistics, particularly in formal 
university courses . They endeavoured to arrive at what seemed 
a "best" organization from a student's point of view. This 
initial organization, recognized to have some weaknesses, 
formed a basis for discussion with the curriculum group, who 
were in turn guided by the principles of conceptual ordering 
cited. Their suggestions resulted in a number of changes, 
which may be illustrated by comparing the initial and revised 
scheme in Figure 1. 

INSERT FIGURE 1 HERE 
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FIGime 1. STRUCTURE OF ELEMENTARY STATISTICS COURSE 

REFORE AND AFTER APPLICATION OF PRINCIPLES OF CONCEPTUAL ORDERING. 



on the basis of the first principle of conceptual orderincr 
- Identify conceptually distinct areas - sections of inference 
using raw scores as data, and sections using frequency classes 
were clearly separated, in conjunction with this, separate" 
"'Hn-S°''^K" multinomial propertions were intro- 

duced. The second principle resulted in the addition of a 
section designed to tie together the concepts of regression 
correlation, and analysis of variance by referring to their' 
^li^ J? ^ gene^l equation relating dependent to inde- 

™ ? ^° the key notion of each 

area to the student ±t the outset (principle three); careful 
introductions were included for all lessons. The fourth 
principle, that secondary notions should be integrated into 
an overall organization determined by the integral notions of 
tne field, was the basis for the most significant changes in 

^^^k'^k^^.^^''"^^"''^- initial proposals, sections on 

probability and on theoretical frequency distributions had 
appeared as separate units, near the beginning of the course 
Although these are not central to the development of the field 
Of statistics, they are traditionally taught separately at 
tne beginning of a course, so that the student has that knowl- 
edge later on when it is required for the understandiha of 
more central concepts. However, it is difficult for the 
teacher 'to explain, or the student to see, the real purpose 
of the material when it is introduced at this time. There- 
tore, the separate sections on probability and theoretical 
frequency distributions were deleted. In%tead, relevant items 
from these topics were introduced as needrfj*. For instance, 
random variables, events and sample space were part of the 
first section on inference, one of the aims of which was to 
introduce probabalistic statements as distinct from descrip- 
tive statements. The normal curve was taught as it was 
required, justjfcefore the section on the distribution of the 
mean. Tne binomial distribution was introduced when it was 
necessary m a section on "Testing Proportions." These 
changes can be seen by comparing the initial and revised 
scheme. 



During the revision process, several informal neetings 
were held iaetween the curriculum and sequence writing groups 
The final organization of subject matter was accepted and 
endorsed by both groups. Many of the changes to the course 
structure occurred in sections about which the sequence wri- 
ting group had doubts, but lacked the theoretical background 
to realize exactly what changes should be made. The work of 
the curriculum group provided the justification for improve- 
ments m these areas; the graphical presentation provided the 
means for these theoretical notions to be conveyed to the 
sequence-writing group, who could then act upon them 




At this time, the sequence-writing group began to work 
on individual lessons. ^Detailed plans for the lesson struc- 
ture were drawn up and ev^^ated critically within the group, 
before the lessons were actually written. Writing, coding 
and testing proceeded in the normal manner. ^ 

7. Project Evaluation by Curriculum Group* 

The organization of stacistics which was achieved was 
felt to be very satisfactory from tha^point of view of the 
curriculum group. 

The merit of the principles of conceptual ordering as a 
practical guide co course structure will only be fully deter- 
mined when sequences for the whole course are completed, and 
.the effectiveness of this organization can be compared to 
that of a traditionally organized course. However, the 
curriculum group was satisfied that the current organization 
reveals the overall structure of the subject matter clearly 
and that those students involved in the project felt it 
would have been helpful had such an organization been used in 
tneir statistics course. 

The curriculum group was satisfied that the students can 
successfully play a major role in the development of CAI 
material, allowing the sequence group considerable freedom 
and responsibility for the material produced. This model is 
believed to be a major contributing factor to an ongoing high 
level of motivation and interest in the project. (Previous 
experience has shown that sequence writers often become bored 
and unenthusiastic during the more tedious parts of the pro- 
ject, such as coding). This enthusiasm and the involve neiit 
of the sequence group in all phases of lesson design and 
writing, have also resulted in an excellent quality of work 
at all stages. The students showed themselves to indeed be 
capable of applying standards of quality control to their 
work, supported at the three main levels - course structure 
lesson structure, and lesson presentation - by the evaluations 
and opinions of the curriculum group, CAI technologists, and 
subjects who tested the lessons. 

The use of students as sequence writers, although not 
fully consistent with the philosophy expressed by Mager (a 
fully consistent application would be a totally unstructured 
course) at least recognizes that the optimal path through a 
subject area for a student may differ markedly from that of 
a teacher. 



-278- 



8. Project Evaluation by Sequence-Writing Group 

The students felt from the outset that a pracimatic 
e?™d1rihe^L'"^"" '° procLs^"'^Ms was 

:Keded\r?hr^t~t rSher\hL'\'"°^""''°^°^ ^^^^^^^^ 
„ si:uaent ratner than when convenient for th^ 

Ittu t^' f^^Ple, standardization of raw dita was taught 

raSer ?h^'^?i.r"'^^' ^PP^^^^ meaningf u^yf 

not'read^S be"app??e!?'" °' "'^^^^ 

.v^.o^^^^^"*^^"^!' sequence group were more aware of the 

areas of conceptual difficulty in the subject than an exyert 

JexSookf '''h"^^^' ""^"^ ^^^^ ^^^^ in'most in?roduc?o?J 

textbooks and courses, too much emphasis is placed on for- 

?eerfS^h^\^K°''^I? ^^laining concepts Ind developing a 
^ttiJ ^ t subject. They saw tutorial CAI as an ideal 
method for teaching and verifying these concepts. 

n,.^o J^?^ "^^""t Particularly aware of the level at which the 
^tltdi^ ""^^ ^° Si"^^ this was an introducto^ 

siSe ?nn^2"fr' ^'^^^ as much as ^s- 

li^lr nc?n ''^■^ developed in a clear, intuitive ma^er 

ai3±e to tJie student than the result itself. Eleaance was 
sacrificed to clarity if the two were in conflict? 

nf i-ht f^^^^g ^hat is .ften easy to "miss the forest beca'JF^ 
of the trees" in a statistics course lead the sequence group 
InJ^^t special efforts to tie the blocks of the\ou?se^ 

^hif ^o^?ned"'wS?l^'''^?H^^r ""^^ °^ introductions and summaries, 
inis combined well with the curriculum group's second and 
third principles to produce many of the final modificaSons 
to the overall course structure. -uv^^xi-ioations 

Ho^r-oo^^^-f^*^"''''*' -writing group found that to a surprising 
degree their confusions and skepticisms were fairly reliable 
inf^of °^ weaknesses in concept ordering, it had been 
horn^ the assumptions of the project, which appears to have 

students would be less attached to traST! 
aid ?iurab??.n P5^=^"tation than the instructors would be, 
S^hfL^ept lh^Sstr — °f the suggestioAs 

wor-o ^K^^^?^ ^^.^ "^ronp, the students in the sequence group 
were able to set a high standard of quality control, by main- 
woik'%?.ho;;'^^?^ check through discussion on each'others- 
i? was tiS^SS?\^^? duration of the project did not permit it, 
turZll thought that It would pe desirable, once writers had 
choses specific lessons for which to write sequences, that a 
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structural breakdown in the same fashion as the overall 
breakdown and involvement of the curriculum group at this 
stage as well might have been desirable • 



9. General Conclusions 

As the curriculum group had observed^ the project 
appeared to verify^ as much as possible in the short time 
available, the thesis that students could carry out work of 
high quality in a self-actuating manner, provided that the 
work was organized around two groups working in parallel, one 
concerned with ordering strategies and the other with lesson 
writing. The ability of the students to work on their own, 
and the mechanism for implicating curriculum theorists were 
the solvent features, x'his mode of operation is of great, 
interest in that it permits students an' active and indeed cent- 
ral role in the educational process. Following this procedure. 
It would seem reasonable to establish courses in which the 
principle work of the course, (at the same time a learning 
and teaching activity of the part of the student) would con- 
sist of the preparation of CAI materials. 

Some aspects of the project deserve further investigation. 
For instance, the utility of the strategies of concept order- 
ing indicate the possibility of an increased role for systems 
theory in the design of a statistics course. 

But the nain result of the project is a new approach to 
design of CAI sequences. Seen in relation to the problem of 
the formation of technical ensembles, the project helps to 
discriminate between the role of the individual and the role 
of the group in the developmert of educational technology. 
The contributions and the needs of the individual have always 
been stressed as an argument for programmed instruction. But 
what does not seem to have been noticed, is that in order to 
enhance the value of the information provided to the individual, 
there must be a correlative increase of the involvement of 
^'arious groups. 

The situation may be illuminated by comparison with an 
educational technology based on printing. Education based 
upon the book is individualistic, not only because the manu- 
script multiplies into a number of copies to serve individual 
readers, but because its main technique, the printed text, 
tends to be the work of one person or of one mind. It seems, 
however, that CAI does not follow this model. There is a similar 
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multiplication of copies but CAI should not be a mode of 
preservation of the thought of the single teacher^ which the 
book does well^ but the concretized influence of teacher^ 
student and concept theorist. In a word^ whereas the book is 
based on an artisanal operation^ CAI is based on a technology 
of the group. 

If this thesis is accepted^ there are two aspects which 
we shall present by way of conclusion. The first has to do 
with the fact that until now course-writing languages have 
been designed primarily to serve the individual teacher. By 
what has been said above^ this is in effect to design CAI 
technology on an artisanal model. By contrast^ our study 
raises the question of how to specify such a language as the 
working medium of a group. 

.A second point concerns the role of the individual 
teacher in CAI. If CAI is group-centered^ the teacher mui:;t 
* become involved as part of a group and in collaboration wifch 
curriculum and student groups. Thus the individual teacher 
must search for a new type of engagement in the educational 
process. This does not imply that the roles of the teacher 
in any one of the traditional senses must disappear^ but that 
they must be expanded to include the new collective activities. 
Just as the student loses his narrow dimension of learner^ so 
the t acher loses his narrow dimension of professor. This 
could have salutary benefits for the renovation or the educa- 
tional system as a whole^ because the change cannot come 
about without the consent of the principal groups concerned 
and the new technology is therefore free to grow up naturally 
within a particular social environment. 
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Successful use of an interactive computing system demands a basic knowledge 
of the hardware and software which together comprise the on-line system. Misuse can be 
costly in terms of time and money* At the University of Western Ontario, many under- 
graduate Computer Science students are required to use a Digital Equipment Corporation 
PDP-10 computing system* Each year, when an influx of new students occurs, the 
problem of communicating sufficient information to assure competent usage 
presents itself* 

During the summer of 1971 a team effort resulted in a teaching package 
consisting of two video-taped lectures, nine C.A*I. lessons and several pages of 
prepared notes* Its aim is to provide an opportunity for self-paced, independent 
learning by any student requiring information about the on-line computing system* 
The lectures serve to introduce some basic concepts in a graphical way, while the 
prepared notes provide the students with a permanent copy of detailed information. 
The C*A*I* lessons, the most vital element in the package, enforce concepts in the 
lectures, introduce new concepts and in some senses simulate the on-line system for 
the student* 

During the Fall Term approximately one hundred students in Year II 
of a BSc program in Computer Science used the learning package* The video-taped 
lectures were shown to the students in groups. Each student reserved a carrel in 
the C*A*I* laboratory for two hours per week for the puroose of running lessons* The 
laboratory containr ten carrels, epch equipped -with a q.iet terminal with a phone-line 
connection to the central computer, and a remote access slide projector and rear- 
projection screen* Students were free to run as many lessons as time permitted in a 
session at the terminals* Typed material was available on request from the laboratory 
supervisor. 

Using the on-line computing system to each about itself has a number of 
advantages* The one-to-one nature of the situation requires that each student become 
an active participant in the learning process. As the student runs the C.A.I, lessons, 
his familiarity with an on-iine terminal itself increases and consequently his confidence 
grows* He is exposed directly to the behaviour of the on-line system, growing accustomed 
to such features as variation in response time* In the advanced lessons, the opportunity 
to type commands to tlie teaching progra.i, which functions in a simulation mode, allows 
the student to practise forming commands under the protection of the C.A.I, lesson. 

COMMENT APPRENDRE A CONVERSER AVEC UN ORDINAVEUR 

Pour hien convers^r avec un ordinateur, il faut savoir ce que c'est qu'un 
ordinateur et en qjoi consiste les programme? . Un mauvais usage de I'orainateur peut 
etre tr^s couteux et faire perdre beaucoup de temps. A I'Universite de Vsestern Ontario, 
de nombreux etuc'iants en informatique doivent :;e servir d'un ordinateur PDP-iO. Chaque 
annee, nous devons resoudre le probl^me consistant S npus assurer que les etudiants 
sauront se servir de cette installation* ^ 

Au cours de l*ete 1971, une equipe a er.seigne comment se servir de cettc 
installation ^ I'aide de deux cours enregistres sur bandes magnetiques audio-visuelles , 
de neuf legons presentees par ordinateur et de quelques pages de notes preparees. Le 
but de cettc equipe est de faire en sorte que tout etudiant puisse s*instruire indopendam- 
ment et ^ sa propre vitesse en faisant appel 3 la liaison dont il dispose avec l*ordinateu 
Les cours presentent quelques notions de base sous forme graphique et les notes 
fournissent des renseignements detailles. Les lemons, element le plus intercssant, 
renforcent le cours, presentenr de nouveaux concepts et, en queique sorte, simulenc la 
liaison avec I'ordinateur* 

Durant I'automne, environ cent etud*.its en dcuxiSme annee du premier cycle 
en informatique ont. acquis dc Inexperience avec cette installation. Les conferences 
audio-visuelles enregistrees ont ete donhet-s devant des grcupes d* etudiants* Chaque 
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A geography question appears on the cathode ray tube; 
after reference to a map and some deliberation, the student 
types an answer and immediately receives confirmation that he 
is indeed correct. A systems programmer, tracking down ■ a prog- 
ramming bug, types a command to suspend execution at a particular 
point in the troublesome routine; after interrogating the 
system for certain variable values, he commands the system to 
make a change in a variable and to resxame execution of the 
routine; output indicates the error has been pinpointed. An 
engineer indicates with a light pen where he wishes to make a 
structural change in a bridge design; within seconds the compu- 
ter informs him of the effects of these changes. These 
applications illustrate the interactive nature of on-line 
computer usage. The user and system together form a powerful 
man-machine partnership. The system requires decisions and 
input from the user at various stages during a program'." 
execution. The user requires the output produced by the sys- 
tem in response to his earlier commands as ^a basis for 
further decisions. The versatility of this partnership is a 
consequence of the direct link between the user and computer 
system made possible in the on-line environment. 

The cost which the user must pay for interaction is 
increased responsibility e-ring the development and debugging 
of programs. Unlike a ba. 3h-proc es sing system, where the 
user loses contact with his program from the time the deck is 
submitted for running until the output is picked up, the on- 
line system does not isolate the user from his program during 
any phase of its processing. The user sits at a terminal 
which is connected to the computer and interacts with the sys- 
tem. He may enter his program by typing at the terminal. He 
must then direct the system to compile, load and execute his 
program. At any time he may interrupt what is happening to 
make changes in his program or to issue new commands to the 
system. Thus ^ .ccessful use of an interactive computing sys- 
tem demands a basic knowledge of the hardware and software 
which together comprise the on-line system. Misuse can be 
costly in terms of time and money. 

At the University of Western Ontario, several undergraduate 
Computer Science courses require students to use a Digital 
Equipment Corporation PDP-10 time-sharing system. Each year, 
when an. influx of new students occurs,* the problem of communi- 
cating sufficient information to assure competent usage 
presents itself. Unfortunately, the required information was 
not readily available from a single source. Instead, pertinent 
informafeion was scattered throughout a number of ccr. puter 
manuals, which are intended primarily as reference anuals 
rather than as teaching aids. Nowhere in the man'iai.s was a 
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suitable overview presented. Initially the course instructors 
concerned tried to conununicate the necessary information by 
lecturing independently to their classes, with great dupli- 
cation of effort. A review of the situation, prompted by 5 
feedbav^k from the students, clearly indicated the need for a 
co-ordinated teaching package. 



Planning An Integrated Instructional System 

In Spring, 1971, a team of six members assumed the 
responsibility for developing a teaching package. A faculty 
member, two course assistants and three undergraduate stu- 
dents comprised the group. The faculty member and course 
assistants contributed an interest in teaching, and experience 
in presenting information about the on-line system in the 
conventional lecture manner. The students brought to the 
project enthusiasm, recent learning experiences, and few pre- 
possessions about teaching. 

The overall goal of the teaching package was to provide 
an opportunity for self -paced, independent learning about the 
on-line system such that upon completion of the package a 
student would be sufficiently competent and confident to enter, 
debug and test a Fortran program on-line. It was unanimously 
agreed that the package musu do more than teach the student 
a recipe to follow step by step. It had to present a co- 
ordinated picture of the computer system, stressing the role 
of system con.pone.. ^s and the purpose of each step in the 
processing of a program. With this information, a student 
should be better equipped .to adapt to a situation differing in 
some respects from examples presented in the package. 

With the overall goal and a more detailed description ''of 
the desired termirxal behaviour in mind, the group tackled the 
identification of concepts and related system commands wh^ch 
must be presented in the package. The undergraduate students 
were of particular value during this planning phase as they 
were able to point out where they had experienced difficulties 
and misunderstandings. 

T^e next phase involved a review of available instructional 
media and the roles they could play in this instf uctional sys*tem. 
Video-tapes, films, slides, reading material ancLCAI were' 
considered. Subsets of the concepts and details^ to be ta iht 
''ere discusser^ in relation to possible methocTs of presenta- 
tion. One fact became very clear - no one medium could 
satisfactorily communicate all the information. Instead, an 

4; 
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integrated instructional system seemed desirable^ with each 
medium being used where it seemed most advantageous. 

Some of the material to be presented was better suited 
to a pictorial rather than a verbal presentation. In par- 
ticular some topics lent themselves very well to animation, 
Tnis seemed an ideal application for video-tapes since part 
of their potential is the ability to present information in 
a manner which would be difiicult^ if not impossible^ to use 
in a live lecture. The philosophy was thus to use the video- 
tapes to present "television lectures" rather than simply 
"televised lectures". 

The information to be presented also included detailed 
PDP-10 conimands ^of which the student must have a permanent 
copy, Reading material seemed appropriate here, 

Last^ but not leasts it seemed that CAI could play a 
vital role. Interaction was the key. CAI could make tne 
stud.ent an active participant m the learning process, by 
asking him to demonstrate his understanding of one concept 
before another was presented. As a bonus, students would 
gain experience with the actual on-line system and terminals 
about which they were to learn and would gain confidence in 
a new environment. It was felt that slides should be inte- 
grated with tne lessons. 

It v;as not enough just to realize that each of the media 
mentionned had a role to play in the teaching package. Care- 
ful consideration had to be given to the degree to which one 
part of the presentation should depend on another and to the 
nature of this dependence. While modularity could increase 
the useful^ '^s of the package, it was of utmost importance 
that the eix result should- not be just a collection of devices 
out rather an integrated instructional system. 

The final package is comprised of two video-tapes, nine 
CAI lessons and several typed handouts. The video-taped 
lectures serve to introduce basic concepts in a graphical 
way, while t/i^ prepared notes provide a perman^jnt copy of 
detailed information. The CAI lessons, the most vital ele- 
ment in tne package, enforjce concepts presented in the lectures, 
introduce new cone ts^ and in some sense simulate the 
on-line system for .the stadent. 



i 
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The CAI Component 

The nine CAI lessons included in the teaching package 
m&y be divided into two. groups. Seven of these lessons deal 
with a number of system components and the steps in processing 
a Fortran program. The remaining two lessons deal with a 
specific system program called TECO which billows on-line 
creation and editing of files. The lessons are coded in ETL 
(Educational Technology Language) , 

.Each lesson can easily be run in a one-hour session at 
a terminal. This constraint on length was imposed because 
of the difficulty of concentration for longer periods and to 
enable students to use a spare period between classes to run 
lessons , 

The style of the lessons is informal and friendly, and 
occassionally humcrous. These lessons bear the mark of their 
enthusiastic authors I For example^ the group conceived the 
idea of personifying certain system components as cartoon 
characters to better help students remember important charac- 
teristics. The monitor was represented as an octopus, with 
each of his arms busily looking after a user of the time- 
sharing system. The disk was presented as a filing cabinet 
character, where the many drawers reminded students that the 
disk is a sharable device where each user has his own private 
area (drawer) , 

The structure of the lessons is generally a spiral one. 
Concepts are introduced and skimmed over lightly. The same 
concepts are then presented again in more depth. Finally, 
the PDP-10 commands related to the concepts are presented. 
This approach was chosen because the system components are so 
interrelated that it is difficult to separate one from the 
others in order to discuss it in detail, 

A variety of instructional strategies are employed 
throughout the lessons. These include drill and practice, 
tutorial^ simulation and inquiry strategies. As an example, 
let us consider the seven on-line system lessons. The first 
two lessons seive mainly to enforce concepts introduced in 
the video-tapetl lecture. Consequently, they use a blend of 
drill and practice and tutorial strategies. Lessons three and 
four expanc. on these concepts and introduce related concepts - 
the strategy here is chiefly tutorial. Lesson five provides 
drill and practice on the use of the PDP-10 commands. Wesson 
six uses a limited simulation strategy, giving students a 
chaii|c.e to practice the step-by-step processi^ig of a Fortran 
program. Lesson seven is a review lesson which allows the 
student to choose a topic 



from a list of available topics,,, heiice operating in an 
inquiry mode. 

All nine lessons make active use of slides. These 
slides serve to present text if it is rather long to be typed 
out by the lesson or to present pictorial information. 



Production and Testing 

The team of six divided into smaller groups during the 
actual production of the teaching system components. Two 
meinbers worked on the TECO lessons and typed hand-rOuts. They 
cb^rbrdinated their efforts through discussion, but chose to 
assiime separate responsibility for the production of one CAI . 
lesson each. The remaining course assistant and students . 
tackled the more general pn-line lessons and notes-. They 
#m]^16yed a different Strategy as all three contributed ideas, 
quisstiohs, and examples to a single lesson. The faculty mem- 
ber acted as a supervisor and^ resource person, and assiimed 
responsibility for the production of two video-taped lectures. 
Th^ entire group met regularly to exchange ideas and to 
report the progress of the subgroups. These meetings were 
imperative to ensure the co-ordination of the package 
components . 

Time constraints did not permit major testing of the 
package before the end of the summer. The team spent many 
hours doing testing and solicited the aid of other department 
members, but no sizable group of students tested the package 
before its actual introduction into a number of undergraduate 
courses . 



Application 

During the academic year 1971-72, approximately one 
hundred and seventy-five undergraduate Computer Science stu- 
dents used the learning package. At the outset each student 
received a guide which clearly outlined the chronological 
order to be followed in using the video-tapes, typed notes, 
and CAI lessons. 

The introductory video-tape was shown to a class during 
a regular lecture period. The second video-tape was shown 
in small groups as they reached the appropriate point in the 
course. Replays were availcUule at anytime upon request. 
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Lessons wer*^. run- in the CAI laboratory. The laboratory 
contains ten carrels^ each equipped with a quiet terminal with 
a telephone-line connection to the central computer^ and a 
remote access slide projector and rear-view^ projection screen. 
Five of the terminals produce hard copy while five do not. A 
supervisor is present at all times to^ assist students who 
encounter equipment or system problems.^ 

Each student reserved a carrel in the laboratory for two 
hours per week for the purpose of running lessons. He was 
free ;to run as many lessons as time permitted in a session at 
the terminal and was also at liberty to spend more than the 
two hours per week in the laboratory if a terminal was free. 
Typed: material was' available on request from the laboratory- 
supervirisor. On the aver age, students completed the package 
in three tb four weeks. 



Results. and Conclusions 

Student reaction to the teaching package was generally 
favourable. Some feedback was available informally while the 
students were involved in the course. An evaluation form was 
used to solicit more formal criticism some time after the 
course was completed. Students indicated that in their opinion 
video-tapes, reading material, and CAI lessons were all 
valuable components of such a package. 

Most comments concerned the CAI lessons. Students 
agreed that the lessons were interesting and that block size, 
question difficulty, information density, and lesson length 
were satisfactory. They felt that the overview could be more 
strongly emphasized and that additional drill on the PDP-10 
commands should be included. As could be expected, some ques- 
tions were considered to be unclear and a nximber of minor 
bugs were found. This feedback and an analysis of, the statis- 
tics collected for each question will hopefully provide a 
good basis for raaking improvements in the lessons. 

A majority of the students commented that hard copy of 
their lesson runs was highly desirable. This was emphasized 
by the fact that students entering the laboratory selected the 
terminals without a provision for hard copy only if all the 
other terminals were already in use. The hard copy assumed 
importance after the running of a lesson rather than during 
.it - i.e. students did not wish to refer to the listing during 
the lesson, but wished to study the listing at a later time. 
This may indicate a weakness in the typed material included 



^ . -291- 



in the course, as its role was to provide the student with a 
permanent copy of detailed inf ormation.^ » 

Comments and criticism are valuable but "The^' proof of 
the pudding is in the eating". At the conclusion of the course, 
the students were given an assignment to use the PDP-10 
on-line system to enter and run a Fortran program, to make 
specified changes in this program and to run the modified ver- 
sion. The student was then to bring the results of his 
efforts to either his lecturer ot a course assistant for dis- 
cussion. The students were not instant experts. They made 
mistakes and spent far more time doing the assignment than an 
experienced user would. However, they approached the assign- 
ment with a/ degree of confidence and were able to complete 
it with little help from anyone else. Discussioh revealed 
that they were equijpped to understand the consequences of the 
mistakes they made. It was. also interesting to note that 
these students made the transition from processing Fortran 
programs on-line to processing assembly language programs on- 
line very smoothly. 

This teaching package seems to fit well into an under- 
graduate Computer Science course. The attempt^ to integrate 
several media was appreciated by the students. Using the 
on-line system to teach about itself has a number of advan- 
tages. The one-to-one nature of the situation requires that 
each student become an active participant in the learning 
process. As the student runs the CAI lessons, his familiarity 
with an on-line terminal itself increases and consequently 
his confidence grows. He is exposed directly to the on-line 
system, growing accustomed to such features as variation in 
response time. In the advanced lessons, the opportunity to 
type commands to the teaching program allows the student to 
practice forming commands under the protection of the CAI 
lesson. Here mistakes are learning experiences without severe 
penalties in terms of time and money. 
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M^THODE.ANALYTIQUE DE FABRICATION DE COURS CAI SESSION 8C 

By/Par: Robert Brlen, ROOM/SALLE 143 
Professeur, 

Service de I'informatique. 

Plusieurs chercheurs considSrent la construction de cours valables dispenses 
par ordinateur comme etant un probl^me f ondamental • 

La necessite pour I'auteur de mattriser un langage de prcgramoation, le temps 
mis ^ la construction d'un cours, le manque de strategies bien definies font que de 
nonbreux pedagogues se privent d'un excellent outil d'enseigneirent. 

Dfes 1* implantation du SystSrae 1500 en janvier 1970, des membres du Laboratoire 
de Pedagogie Informatique de Quebec se penchSrent sur ce probl^me, Di verses techniques 
de construction de cours f urent experimentees dont une methode global e basee sur des 
modules d'enseignement (strategies) qui permet ^ I'auteur de contourner les difficultes 
de la prog rammat ion. 

Cette premiere metfiode de construction de cours developpSe et utilisec par 
les membres du L.P.I, forga ces* demiers I s • interroger sur les crit^res de validite 
d'un cours dispense par la machine et ^ redefihir de fa9on plus rigbureuse les actions 
pgdagogiques ^que devrait adopter i'auteuf dans I'glabdr^^ son cours. 

Lc but de i expose est justement d'ex^jliquer comment, ^ partir de,la m^thoda 
SPC elabofee eh 1970^ nous en sommes vehus ^ une noiivelJe approche susceptible d 'aider 
I'auteuf dans le developpement de son cours CAI. 

ANALYTICAL METHOD OF CONSXnUCTING CAI COURSES 

Many researchers feel that the design, of .worthwhile courses to be given by 
computer presents a basic problem. 

Because of the necessity for the author to master a programming language, 
of the time taken in constructing the course and of the lack of well-defined strategies, 
many teachers do without ah excellent instructional tool. 

As soon as they received the 1500 System in January 1971, the members of 
the Computer-aided Teaching Laboratory of Quebec began studying this problem. Various 
methods of designing courses were tested one of which was a global method based on 
teaching models (strategies) which allowed the author to get around the difficulties 
of programming. 

This first method of court;e making, developed and used by the members of the 
Computer-aided Teaching Laboratory, forced them, to question the validity criteria of 
a machine-given course and to redefine in a more rigorous way the teaching practices 
that the author should adopt in setting up his course. 

The aim of this paper is precisely to explain how, beginning with the SPC 

method designed in 1970, we have arrived at a new approach capable of helping the 

author in (developing his computer-aided instruction. 

I 
I 
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DESIGNING PROGRAMMING UNGUAGES FOR COMPUTER BASED SESSION 9A 

. INSTRUCTIONAL SYSTEMS IN RELATION: TO INSTRUCTIONAL PROBLEMS ROOM/SALLE 145 
By/Par; G. H. Roid, 

McGill University, 
Universite McGill. 

Many of us in instructional technology all too often have "solutions*' 
and search for instructional problems to fit them. If the reverse were true and 
educators brought their problem to us before computer-based systems were designed 
a number of new design .principles would be needed. This problem is particularly 
important in the design of author languages because they must span the gap bet^^een the 
instructional problems of non-computer people and machine implementation. 

Language design has, in the past, been guided more by programming consider- 
ations than by the need to. implement; a wide variety of instructional solutions. 
Particularly when instructional problems and thetr solutions dictate the need for 
simulation or sophistication multimedia display, most of nur. present author languages 
are inadequate. 

The author of this paper is currently involved in experimentation. and 
development of new author language capabilities with these problems in mind. Experience 
consulting with teachers and professors about instructional problems has influenced 
these development. , This work is described and discussed. 

LA, CONCEPTION DE LANGAGES DE PROGRAMMATION POUR 
ORDINATEURS AU SERVICE DE L'ENSEIGNEM£NT_EN 
FONCTION DES PRORLEMESI-PEDAGOgTqUES 

Nous sbmmes nonibreux, en technologic pedagogique, S avoir des "solutions" 
et S chercher des probl^mes pedagogiques qui s*y adaptent. Si I'inverse etait vrai, 
c*est-l-dire que les enseignants nous am^nent leurs problSmes avant I'elaboration des 
syst^mes ^ base d^ordinatears , il nous faudrait alors certains principes nouveaux de 
conception. Ce probl&me est d'une iipoortance particuli^re lorsqu'on en arrive aux 
langages utilises par les pedagogues car ces langages . doivent constituer la relation 
entre les probl^mes pedagogiques des enseignants et les conditions imposees par les 
machines. 

Anciennement, la conception des langages a ete orientee plus par les besoins 
de la programmation que par le besoin d'etablir une grande diversite de solutions • 
pedagogiques. C'est surtout quand les probl^mes pedagogiques et leurs solutions 
deroandent une simulation ou des affichages multiples et compliquSs que la plupart de 
nos langages actuels sont inappropries. 

L'auteur de cette communication s'occtipe actuellement de 1' experimentation 
et du.dcveloppement du potentfel de nouveaux langages. De consulter les enseignants 
sur ces probl^mes a influence les developpements et c'est ce que nous decrivons et que 
nous discutons. 
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Designing Programming Languages for Computer Based 
Instructional Systems in Relation to Instructional 

• Problems 



G.H. ROID 
McGill University 

i 

Consulting on problems in instructional technology 
involves an interesting bit of self-control. One of 
the most difficult things about helpiiig people with 
their instructional problems is that solutions come too 
quickly and too easily. Mau^y of . us all too often have 
developed "solutions "arid then search for people with 
problems to fit them. 'Whether we have a computer, media 
equipment or! programmed instruction in hand, it is dif- 
ficult to re^sist advertising it before we have adequately 
defined a "customers" problem. 

If an educator with a problem like "students with 
different levels of preparation for our program" comes 
to- a CAI consultant he is likely to get an individualized 
CA" ,::ystem. If he goes to a media resources centre, 
he - { get study carrels equiped with television, slides^ 
and audio-tapes, if he goes to a group-process expert 
he is likely to get sensitivity* training groups. I guess 
we all have learned to "do our own thing" with unfailing 
energy. This problem is particularly important in the 
design of author languages because they must span the 
gap between the instructional problems of non-computer 
people and machine implementation. Author language design 
has, in the past, been guided more by the need to program 
a small range of techniques rather than the need to 
implement a wide variety of instructional solutions. 
Particularly when instructional problems and their 
solutions dictate the need for simulation or sophisticated 
multimedia display, most of our present author languages 
leave us unprepared. 

The present paper first discusses what constitutes 
a good statement of sm instructional problem. Then, 
applications of computers and author languages are 
discussed in relation to. several examples of instructional 
problems • 
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Instructional Problems 

~~ instructional problems are descrepancies that occur 
when someone who needs to be taught something has not yet 
been taught effectively, if a teacher has an image of what 
a student should be able to do upon completing a lesson 
or program, and the student does not fit that image, a 
descrepancy exists for the teacher, if a learner wants 
to.gain a new skill but has not yet found a program that 
deals with it, a problem exists for the learner. • 

Instructional problems are not always clearly identified 
or described. It is imperative that they are clearly 
stated, however, before a solution, particularly a 
technological one can be tailored for them. Problem state- 
ments made by educators sometimes lack obser\'able evidence, 
data or descriptions of student activities. For example, 
one might hear the complaint, :"my students don't under- ' 
stand geography biecause we have so fev? detailed maps to 
show them". It is not clear what is meant! by "understand 
geography", in terms of what student? do or do not do. 
Perhaps lack of discussion in class, poor test scores 
or other evidence is present, but is not stated. A 
prematurely diagnosed cause is included — "we have so 
few maps". One of the f-^rst tasks of the instructional 
consultant is to help the teacher or learner define his 
problem with clarity and observable evidence.' When this 
has been done a difficulty may still remain, it may 
be that the identified descrepancy in learning is not 
really an instructional problem. A distindtion can be 
made between a Knowledge deficit and a performance 
deficit (Gilbert, 1967, Geis, 1970). Instruction may be 
necessary only if a knowledge deficit is present. If a 
performance deficit is present, the learner has a skill 
or a set of understood concepts, but does not use them 
in the environment in which he lives or works. Something 
as simple as a checklist of steps in a work task or changes 
in incentives for action can bring out unused skills or 
knowledge. A common example of a performance deficit in 
some cases is lack of discussion in a classroom. It may 
be that students know enough concepts (cuid are skilled 
at talking) but for a variety of reasons incentives to 
discuss- are absent (or punishment for saving the "wrona 
thing" is present) . ^ ^ y 

Programm ing Languages and Instructional Problems 

If consultants and educators were to start with well 
formed statements of instructional problems, we would 
find a need for a wide variety of computer programming 
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languages and systems. We would also find that our hard- 
ware or currently available languages cemnot provide a com- 
plete soliition in many cases. Several exeimples from the 
author's experience in consulting with university instructors 
may provide clarity here. 

The^ instructor in a biochemistry course in Medicine 
came to the author to find' out more about a computer- 
based system for self-testing. He had seen the system 
in operation at another university and wanted to know 
if it was feasible to consider adopting it locally. A 
series of discussions were held to identify instructional 
probleuis. The instructor indicated that his major concern 
was that students delayed studying until a short time 
before excuns and did poorly* This was true even though 
copies of previous exams were posted long before test 
time. He felt that a self-testing system which actually 
required the student to give a response before seeing 
the answer to a question might be a solution. 

One could imagine a computer-terminal system which 
would present questions from a question bank and give 
feedback to the student as he responds. Any of the 
frcune-by- frame author languages. "would be suitable for 
programming such a system. But wait! Is liot the question 
answering itself only a part of the instructional 
problem? It seems that no matter what system was devised 
for presenting questions the student has to go to it 
regularly in sufficient time before the exam for the 
problem of "cramming" to be solved. This is a problem 
in self -management. Either the students lack skills in 
managing their time or there are not adequate incentives 
to test themselves early and regularly. So^ another 
element in a solution to this problem may be non-computer 
related. It may be some type of training in progress 
plotting^ or some use of deadlines emd incentives 
(e.g.^ a portion of the course grade)* for self-testing. 

In another example^ the author worked as an outside 
experimenter for a large psycI;ology course. An instruc- 
tional problem was defined bj the low mid-term exam- 
ination scores achieved by some of the students. These 
students were apparently not responding well to the 
lectures^ conferences and readings in the course — 
but due to some as yet unidentified problem, since an 
experiment in the use of time-shared computer terminals 
to present CAI lessons (of a programmed-instruction type) 
in the course was planned anyway^ the underachieving students 
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were chosen as likely subjects./ An author language 
similar to LYRIC was programmed for th*5 time-sharing . 
system at McGill University (Roid, 1971). The language 
compiler was written in FORTRAN to speed development ' 
(but not, of course, execution timei) A study of tlie 
students, their learning, and their evaluation of the 
CAI lessons used, revealed that the lessons were effective 
because they simplified the laiiguage used in the course's 
textbook and provided many common examples of concepts. 
This appeared to be due in part to the fact that most of the 
students in the experimental group did not have English 
as their first language.- Thus, the true .Instructional 
problem seemed to be more specifically related to a des- 
crepancy between the reading ability of the students and 
the level of the text. The Use of the computer and any 
author language, ger se.-iwould not insure that this problem 
was solved.*'- Perhaps an 'author language which provided 
functions needed ±o help^ the educator assess the reading 
level and rates of students would help in such a 
situation^ However, even if a lanauaqe did, it would have 
to allow lessons to be •*re-written'' to conform to the 
proper level — a job of such complexity that might best 
be done off-line. 

The author language developed for this experiment 
was called MULE (McGill University Lahguc</e for Education) . 
It was used in an""augmenFed form in other settings. In 
one such case Educat' on students weri) introduced to CAI 
by using MULE to code questions for weekly quizes in their 
course. Part of the instructional problem was the students 
lack of familiarity or skills in the use of the computer 
in education. However, another less specific problem was 
reflected in the need for weekly quizes. The compiler and 
executive program for the MULE language had to be altered 
to allow for a random sample of quiz questions (coded 
in the MULE language) to be drawn from a weekly pool of 
questions. The relative simplicity of the author language 
proved to be an advantage in this setting. Students were 
able to gain skills in using CAI quickly and easily. 

In another situation, computer aid? were heavily used 
in the author's course on multivariate data analysis in 
Psychology. Two of the instructional problems identified 
in this course were: 

1. Students had no skills in using computers, 
or computer terminals. 

2. Students had no skills in analyzing data using 
computer programs. 
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That the first problem could not bu solved by CAI or. ah f * 
author language should be obvious. However, once a^ 
minimal level of skill in operating a computer termix.al 
and running specifically :,iaii^ programs was attained, * 
a set of CAI lessons in conqputer system commands and usage 
were helpful as reference material* 

For the second problem^ a set of interactive ^ 
statistical programs were found already available on the 
university time-sharing-, system. These were not' completely 
••ins^tructive** in that some terminology and statistical 
knowledge 'was assumed for all of them* The development 
of coir^letely adequate lessons with statistical computa- ^ 
tions build in would have required a high level author 
language. APL which is only now availsODle at McGill 
University might have been appropriate. However, this 
particular installation of APL does not allow for 
large sets of data to be stored easily and operated upon 
by an APL program in "the fashion needed in some multi- 
variate problems. The packaged programs already avail- 
able ran on a systiem (McGill RAX) which has limited, but 
quite excellent data file capability. In one case, new 
programs had to be written in FORTRAN (e.g., a prograiTt 
which generated large Monte Carlo data sets for in>ut to 
canonical correlation analyses) . 

One final example again illustrates the need for 
flexibility in programming languages. Th.e authox^ has 
worked with a Canadian firm designing graphic terminals 
for* CAI and other applications. Software is neec^ed to 
demonstrate the capabilities of these terminals .^nd to 
inclement lessons on them. These terminals will undoubtedly 
be used in a variety of educational settings in which they 
will be connected to a variety of coinputers. A tentative 
solution to this need is 'to develop modules (subroutines) 
in a problem-oriented language (e.g., FORTRAN) which do 
elementary operations such as plot lines or dots on the 
CRT screen. Although such functions exist in other 
laAjguages now (e.g., TUTOR), they can not be directly 
implemented now on this new terminal hardware. Lessons 
f^ould be constructed using the modules developed, either 
through a specific program (i.e., one written in FORTRAN) 
which calls up the modules, or through the use of a 
compiler or interpreter (written in FORTRAN) which imple- 
ments an author Icmguage which indirectly references 
these modules. 
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The Future of Author Languages 

It seems that a CAI center, school or college would 
be adyised, for the present to maintain flexibility in 
the kind of programming languages available to aid 
instruction. This has been suggested by Zixm (1971) . 
Heavy committment to one author language (of the type now 
avcdlable) would appear to unduly restrict the type of 
instructional problems that could be attacked. Further- 
more,' it seems that general-purpose languages such as 
those found on time-sharing systems (FORTRAN, BASIC, APL, 
and many others) may still offer considerable power to solve 
a variety of problems, eventhou'gh they are less convenient 
to use than author languages (e.g: , -COURSEWRITER, LYRIC, 
PLANIT, TUTOR afid many others) . Perhaps we as educators 
can be inf luencial in encouraging the development of more 
general-px|rpose languages (arid specific con^ilers) for time- 
sharing systems. For example, to the authors knowledge, 
ther^j is ciirrently a lack of implementation of interactive 
languages such as JOSS, or a string-processing lamguage 
like SNOB'OL, or a list-processing lauiguage or a simula- 
tion language on timet-sharing systems (see Zinn, 1971) . 
Nor I is there wide spread availability of hybreds of tliese 
languages which might include functions commonly used in 
CAI programs. 

In summary, just as a simple caurpenter must maintain 
a chest full of tools for raany purposes, educational 
technologists of the future will have to maintain a 
multiplicity of programming languages designed for a 
multiplicity of instructional proble>ns. 
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THE USE OF APL IN COMPUTER ASSISTED LEARNING SESSION 9B 

By/Par: P. P.M. Meincke, ROOM/SALLE 145 

Erlndale College, 
University of Toronto. 

A computer assisted learning system using APL has been developed at Erindale 
College of the University of Toronto. The use of APL has a number of distinct advantages 
including cost, computational capability, compatability with existing and future 
systems, and extensive flexibility. A number of institutions, including Orange 
County Community College District, have had considerable success with APL for CAL. In 
this paper the author-language presently in use will be described along with some of 
the programmes which illustrate the powerful advantages of APL. A number of objections 
to the use of APL have been raised, and these include workspace size limitations, 
lack of records, and system error messages. These points will be discussed in the 
light of experience at Erindale which has shown that these objections can be easily 
overcome. 

It is of course unlikely that APL will be the ultimate language for CAL 
but there are certain characteristics such as the ability to define specialized 
functions within the workspace which have important implications for future developments, 
and these will be discussed. Moreover, the programmes are stored as literals which can 
be easily translated into other systems so the work put in to the pedagogy of a programme 
is.not lost. At Erindale, translators and simulators are being written in APL which 
will permit the use of many of the programmes already available in such languages as 
CAN, developed by the Ontario Institute for Studies in Education. 

Although the syscem does not yet have the full capability of the IBM 1500 
system in terms of audio tapes etc., APL is being used to drive a plotter and a 
48t000 item random access microfiche. There is no reason in principle why other facil* 
ities cannot be driven by APL if and when the need arises. 

The experience to date has only been extremely positive. The possibilities 
which are made readily accessible by APL are very exciting » and we are convinced that 
we have only begun to scratch the surface in exploring the potential of APL in computer 
assisted learning. 

L'UTILISATION DE L'APL EN EAO 

On a mis au point un syst^me d' utilisation des ordinateurs dans l*enseignement , 
base sur I'APL, au CollJSge Erindale de I'Universite de Toronto. L'APL presente des 
avantages particuliers dont le cout, les possibilites de calcul, celles d* adaptation 
au syst^me actuel et ^ venir et sa tr^s grande souplesse. Certains etablissements , 
dont le Orange County Community College District > ont trSs bien reussi en se servant 
de l^APL pour I'EAO. Dans cette communication, nous decrivons le langage de program- 
mation des cours et certains programmes illustrant les grands avantages de I'APL. 
On a eleve des objections au sujet de I'APL comme, par exemple, ses limites de mcfmoire, 
son manque d* informations enregistrees et ses messages d'erreurs. Nous en parlerons 
en fonction de notre experience qui,^ Erindale, a montre que ces objections peuvent 
Stre ais6nent refutees. 

Naturellement, il est peu probable que I'APL deviendra le langage ultime des 
ordinateurs pedagogiques mais ce langage presente certaines caracL6ristlques qui sont 
inportantes pour I'avenir, dont nous discuterons et dont nous donnons, commc exemple, 
la possibilite de definir des fonctions specialisees dans le domaine du travnlK De 
plus, les programmes sont mis en mSmoire sous une forme qui peut etre facilcment 
transposes dans d'autres syst^mes de sorte que le travail pedagoglque d'un programme 
ne sera pas perdu. A'' Erindale, les travaux de traduction et de simulation sont 
formules en APL ce qui permettra de se servir de nombreux programmes existants dans 
des langages tels que le CAN mis au point par I'Institut ontarien de recherche en 
education. 

Quoique le syst^ne n^ait pas encore la puissance du syst^me IBM 1500 en 
nati^re de bandes phoniques, etc., 1*APL sert ^ commander une traceuse et ^ consulter 
des microfiches au nombie de A8000 et aleatoirement. II n'y a aucune raison, en principe, 
pour que I'APL ne commande pas eventuellement d'autres installations. 

^ notre experience n*a ete qu* extrSmement positive. Les 

possibilites ouvertcs sans difficulty par I'APL sont tr^s interessantes et nous 
somraea persuades que nous ne venons que d' explorer supcrflciollement les possibilites 
de 1 APL dans 1' enseignement d I'aide d' ordinateurs. 
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THE USE OP APL IN COMPUTER ASSISTED LEARNING 



by 

P.P.M, MEINCKE 

INTRODUCTION 

When the spirit moves one to an interest in Computer 
Assisted Learning (variously known as Computer Aided 
Instruction, Computer Assisted Teaching etc) one is faced 
with bewildering galaxy of systems. There are 
COURSEWRITERS, CANS, TUTORS, CALAPLS and so on. After a 
little investigation, it soon becomes apparent that there 
are two major ways of becoming involved : If the individual 
is good at finding outside support, he has, up to now, been 
able to find a few hundred thousand dollars or "even a few 
million to set up a major installation. IBM has supported a 
number of COURSEWRITER installations , but some of these 
major installations have found it difficult to continue 
after outside support is withdrawn. 

The other way of becoming involved is to buy or rent a 
few temKiinals and set up a communications link to a major 
installation. This, method is the one which the National 
Research Council has been advocating, and they have set up 
an extensive facility in Ottawa into which any interested 
parties can connect their terminals. Indeed, the directors 
of most major installations have ,up to now, encouraged 
others to use their facilities as long as there was 
capacity to spare. But there are some minor difficulties 
with such arrangements. The first problem is of course 
getting an invitation to join the system, but this seems to 
present a minor difficulty to most people. There are 
problems such as the lack of control over the system, and 
one is essentially at the mercy of the major interests in 
the system. Since changes would be difficult to make in 
most systems to which a large ntunber of users are 
connected, the ability to innovate can sometimes be 
severely curtailed. This is not true of all systems but 
certainly should be a consideration in making a decision to 
proceed in this manner. The main advantage of this kind of 
operation is that it allows one to keep up to date with 
what is going on in the major system. 

There is another possible way to explore CAL which we 
have found most useful at Erindale, Basically , the idea 
is to use a powerful, high level interactive language on 
which to build the CAL system. At first sight, this may 



-334- 



seem to be a very expensive way to run a CAL system^ but 
the actual running costs , although they are certainly 
greater than a system specifically designed for CAL^ are 
not that far cut of line and there is a great saving in 
development costs* In addition^ one is using the same 
teanninal for a number of things and this also helps with 
the cost factor* 

There are at least two essential ingredients^ 
however* One is a highly cooperative and efficient 
Computing Centre which keeps the Interactive System going 
with a high degree of reliability^ and we have been very 
fortunate in having the support of the University of 
Toronto Computing Centre* Another essential ingredient is 
at least one bright creative expert in the interactive 
language* in this area^ we have been very fortunate in 
having .Mr* David Vaskevitch^ who has played a central role 
in setting up this system while enrolled as an 
undergraduate at the University of Toronto* He is giving a 
paper in this Conference on the work he is doing in setting 
up programs to teach Symbolic Logic* 

When I originally decided to use APL as a basis for 
CAL^ the decision was based on the potential flexibility of 
such a system^ the relatively low cost^ the fact that we 
could operate at any level from one terminal to more than 
we could afford to rent at that time^ and the fact that 
APL was a highly reliable interactive system which required 
no effort on our part to meintain* it seemed to me that 
APL was much like a piece of commercially available^ 
reliable but highly versatile research equipment which 
could be used to explore many facets of this rapidly 
developing field quickly and easily even though it might 
not do any one job as quickly and as efficiently as a 
specially designed tool* 

Since then^ David has developed the original package 
extensively and we have only recently started to make 
direct comparisons with other systems* We have found to 
our surprise that this system based on APL compares very 
favourably with other systems in such respects as cost^ 
number of students^ response time^ and others which were 
not given as much weight as flexibility and reliability in 
the original decision* For example^ if we analyze the cost 
in the same way many others do^ we find that a system based 
on APL used by 100 students at a time* could cost just a 
little over $ 1 per hour * Moreover , we have direct 
empirical evidence that an APL system can be used by more 
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than 100 people simultaneously without objectionable delay 
in response time. It is not possible to go into the details 
of an APL system at this time to show how this is possible^ 
but a fev; of the more general features of the system will 
be described. 

SOME CHARACTERISTICS OF APL 

APL^ (A Programming Language) is a very high level 
programming language with a high degree of internal logic 
which is especially suited to interactive programming. It 
is an interpretive system and as such can be rather 
inefficient' in its use of computer time^ but it is 
estimated that APL reduces the time required for program 
design by at least a factor of five. It is an extremely 
forgiving language and allows even the most inept 
programmer to get something going even if it is 
inefficient. 

Now, all this talk of inefficient use of the computer 
makes most computer experts wince visibly, but I am 
convinced that we are very rapidly reaching a trade-off 
point between human effort and computer effort. Certainly, 
it is true that one cannot afford to be inefficient in the 
huge and repetitive number crunching operations, but there 
is a very great need for "one shot** computer programs and 
APL fills this need admirably. This interactive system is 
particularly useful in designing program systems as has 
been shown in business applications, but even there it has 
been found economical to use APL after the program design 
is complete. 

There is still a great deal to learn about computer 
assisted learning and it is my contention that the system 
which is used to explore this rapidly developing field 
should place as few barriers as possible in the paths of 
those who wish to explore uncharted paths. The system 
should allow this initial exploration to take place as 
easily as possible. If new and fertile land is discovered, 
the inefficiencies of the programming can always be tidied 
up later to conserve computer effort in the event that 
large numbers of students are using the program. Even this 
rather cavalier attitude toward inefficient use of the 
computer has not really given rise to any real evidence of 
waste. There is far more wasted effort arising from 
inability to write decent lesson material. 
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APL is an interpretive language^ that is it interprets 
each line as it comes along, and executes the operations 
contained in that line. APL does not compile a program as 
do most systems, and therein lies a certain amount of its 
inefficiency. However, this interpretive characteristic 
does lend itself to interactive programming* Another saving 
grace is that the programming can be very sophisticated and 
each line can contain a vexry large number of operations so 
the number of lines in a program is drastically reduced 
which also reduces the running time. In fact most APL 
programmers spend a good deal of their time comparing how 
much they can pack into one line of APL. The standard 
phrase is ••Oh, I did that in one line.'* 



The system is outlined in figure 1. A rather large 
amount of high speed core, (about 250,000 bytes), is 
required although York University has developed a version 
which will run on only 76,000 bytes. When a user signs on, 
he is assigned an active workspace of 36,000 bytes which is 
stored on disc until some action by the high speed core is 
J^equired. At that time, the active workspace is put into a 
Slot in the high speed core where the APL interpreter then 
.acts on th^ instructions stored in the workspace. 

There are libraries of workspaces also stored on the 
discs cmd therefore available at all times. The user does 
not have to wait for tapes to be loaded or discs to be 
brought up. He simply loads a copy of the workspace stored 
in the library into his active workspace and that copy is 
uniquely his until he signs off or stores the workspace in 
his own library. 

If many students are using the same lesson at the same 
time, there are many duplicates of the same lesson, one for 
each student. This duplication is wasteful if the CAL 
periods are to be highly scheduled ,and , indeed, most 
systems specifically designed for CAL store lesson material 
in a space which is common to many students. It is our 
feeling that the freedom gained for the learner is worth 
the extra cost in the operation of the computer. The 
learner is free to roam through the entire library and does 
not have to go to the terminal only when his lesson is 
available during the scheduled hour. Moreover, many of 
these more tightly designed systems start to run into 
limitations when more complex manipulations are 
encoiintered. 
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The workspace for a CAL lesson is divided up as shovm 
in figure 2. Approximately 4000 bytes are required in 
every workspace for APL overhead. The latest version of 
our CAL requires about 7000 bytes to store the functions 
for the operating codes. This 7000 bytes can be altered by 
the individual author who may not wish to use all of the 
operations codes available or may wish to write some of his 
own. Again, it may seem wasteful to store duplicates of 
the operating code functions in each workspace, but this 
means that each workspace is a completely self contained 
and independent entity. It can be changed without affecting 
the rest of the system in any way or it can be transported 
to another APL system and work just as well as it did on 
tlie original system. This tremendous flexibility is just 
what is needed to stimulate the innovation required in th*s 
field. 

Another problem sometimes arises when the lesson 
material will not all fit into one workspace. Normally, 
the material in one workspace will occupy a student for 
about one hour, but if there is a great deal of remedial 
material, the workspace size can be a limitation. The 
lesson can alwayy be split into two or more worksoaces but 
this normally requires the student to load the next 
workspace which can be a nuisance and somewhat distracting. 
The UNQUOTE operator developed at York University helps out 
enormously in this situation because it makes it possible 
to write a command in one workspace to load in another 
so one effectively has no limitation on the amount of 
material in the lesson. This facility will be available in 
other APL sytems soon. In fact this facility makes it 
possible to develop a PROCTOR which will converse with the 
student, try to find out what the student would like to 
learn while letting him know what is available on certain 
subjects and then automatically load in ti.i appropriate 
material. Such a system has been developed by David 
Vaskevitch for Ryerson Polytechnic Institute which uses 
York APL. 

The APL system also has file capability which will 
allow the gathering of data on various lessons and on 
student performance if necessary. A mailbox system has also 
been developed which will allow the student to send through 
the computer terminal any comments he has about the lesson 
directly to the author, piles could also be used to store 
common operating routines if space should become a problem. 
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The number of users that can be adequately handled by 
the system is determined by the computer and disc drives* 
v;e do not yet have enough experience with the University of 
Toronto system to determine the maximum number of users ^ 
but our experience with a commercial system indicates that 
more than 100 users can be serviced without objectionable 
response time. Apparently^ storage space is not a problem 
since disc packs can be added or> to the system as long as 
the money holds out. (Actually the limit is 2 to the 48th 
power.) 

APL uses symbols rather than English language 
expressions for its operators and although this makes it 
much more universal, there is the problem of learning the 
meaning of the symbols* The mathematical expressions* are 
concise, and it is possible to perform very complex 
operations with very simple looking expressions* However 
there is a very real need for a simple operations code for 
v;riting lessons* These codes can be written as functions 
in APL and naturally , the name of the function can be in 
any language and it will continue to operate on the 
language independent" APL base* 

THE COURSE AUTHORING LANGUAGE AND OPERATION CODES 



It is recognized that many instructors who may wish to 
v;rite lessons will not necessarily be skilled computer 
programmers and the CAL systems usually have a simple 
course authoring language which does not require skill in 
computer programming* Some, such as COURSEWRITER and A 
TUTORIAL sySTEI4, (developed at Cornell University with 
support from IBM) , have the answer processing built right 
in to the system and it is only necessary for the author to 
type in* the questions, right answers, and wrong answers 
with appropriate replies* So far, we have found that most 
of the authors want to have more control over the actual 
structure of the answer processing and structure of the 
lesson even though it requires that they exercise care in 
the writing of branches and providing labels on statements 
but we certainly intend to write a conversational package 
for writing simple programs when the need arises* 

The real problem in course authoring languages seems 
to be that the author soon runs into the limitations 
imposed by the system and the language* He wants to do 
something just a little different, but cannot without 
changing the system, with APL,^this kind of change is much 
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easier to make. The autlior can usually learn enough APL to 
write his own functions for his particular need or else 
they can be written by someone else in a very short time. 
These functions may- not be the most efficient, but they 
will certainly serve the purpose and provide a very 
adequate basis for testing the ideas involved. Moreover, 
they can be entirely contained in a particular workspace 
without disrupting the rest of the system apart from the 
inconvenience experienced by some users because the format 
is not identical to the other lessons. In most other 
systems , it is necessary to have an assembler level 
programmer make the changes involved and it is usually 
necessary to obtain the consent of the other users of the 
system. We have found that innovation is definitely 
stimulated by this freedom from restrictions. 

The operations codes in the latest version of 
NEWAPLCAT are shown in figure 3. Most of them are 
reasonably self explanatory to those who have done any work 
with computer assisted instruction ,but some of them v/ill 
require more detailed explanation. Literal output to the 
student is simply put in quotation marks as in basic APL. 
If the answer is to be interpreted as litera?. data, then 
the READ statement is used while numeric data is accepted 
v;ith the READN statement. These statements also 
automatically look for stiident control commands such as 
END^ The power of APL is demonstrated in the READN 
statement which will accept not only a number but any valid 
mathematical expression. (There are problems with the 
student who is supposed to be drilling in multiplication 
when he discovers that all he has to type in is 3x4 instead 
of 12.) 

The MATCH command is used to check if the student's 
response is identical to the 2mswer required, but care must 
be exercised because even blanks will be counted unless the 
IGNORE instruction is used. This instructi/^n is generally 
used only for numerical responses since it will accept any 
valid mathematical expression. A range of error can also be 
included. 

> 

The SCAN instruction is used much more frequently in 
literal data analysis and it will look for the occurrence 
of a particular set of characters in the response. 

i Alternative sets can be specified with the OR command and 

other required sets can be specified by the AND 
instruction. One very powerful addition is the BEFORE 

■ instruction which specifies the order in which sets of 

I 

i. 
* 
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SCAN 

HAICB *X' 

•r AMD •y* 

OR *Y* 

uroiE 'V 

XGMOXE 
lEFLACES 

COHP 

MTE 

~>STAIT 
S1CF 

~>lAST]t£AX> 



Products a 6 ( D for nuaerlcal data) 
OR the student* s teminal to Indicate 
a response Is required* Also looks 
for student cosnaand words such as END* 
Stores the input from the student in 
systeas buffer BO. READK will accept 
say valid aatheaatical expression* 

The hecrt of the conditional branch states^nt 
U XF SCAN •right ANSWER' 

toohs for the occurrence of the character 
string X in the student's answer* 

looks for an exact match (including blanks) 
of X or the numerical value of N* 

Requires the occurrence of both X and Y* 
Looks for either X or Y* 
X must appear before Y* 

To massage student answer, e*g* 
ICHORE A rtsioves aU A*s from 
student answer* 

Frees the terminal to be used for AFL 
but keeps program available for student. 

Frints out date* 

Initializes program* 

Final statement* 

Will branch to the last executed read 
statement* 



Figure 3 . 
SOME OPERATION CODES 
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characters must appear. The computer statement to look for 
the physical unit "FOOT POUND" would then be: SCAN 'FOOT' 
OR 'FEET' OR *FT' BEFORE 'POUND* OR 'LB' This simple 
statement now looks for and accepts at least twelve 
possible answers including such things as FT-LBS. 

The situation can be improved still further b^^ editing 
the student's responses with the IGNORE and" REPL^CE 
instructions. For example the IGNORE instruction could be 
used to eliminate all occurrences of e or o in a student's 
response and therefore accept FT or FOOT or FEET. In this 
respect, this system based on APL certainly compares very 
favourably with other course authoring languages such as 
Coursewriter and the CAN4 language developed by OISE. 

The set of operating codes has developed through 
several stages over the past year, but all the lessons 
written with even the earliest codes are still in active 
use. The main differences between roost languages for CAL 
lie not in the answer processing capabilities but rither in 
the convenience with which rather complex comparisons can 
be made, and the ease with which lessons can be changed and 
edited ,and in this respect i the present set of codes is as 
sophisticated and convenient as any presently available. 

It is usually informative to compare how a simple 
lesson would be written in various systems. Figure 4 
illustrates how a simple drill in multiplication would be 
written in our system. 

Even this simple example shows the advantage o* having a 
powerful interactive computing language as the base on 
which to build the CAL system. All tlie complex mathematical 
operations are readily available and formatting and space 
reservation are all handled by the APL system. The 
advantage becomes a necessity if more complicated 
mathematical objects such as vectors or matrices are 
involved. 

A list of the progaras which are presently available on 
the system is given in figure 5. 

EQUIPMENT 

Unfortunately, the range of terminals which can be 
used with APL is somewhat restricted at present because the 
transmission code necessary for the full character set in 
not compatible with many of the available terminals. The 
one in use at Erindale at present is the rather bulky and 
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V MULTIPLY [037 • 
V MULTIPLY 
[ 1 ] -t-START 

[2] * HELLO \B1,\ LETS PRACIISE 

MULTIPLYING NUMBERS LESS THAN 13 • 
[3] <?:i4-f-?12 
[U] Bt-?12 

[5] 'WHAT IS TJWffS 
[ 6 ] READN 

[7] -»^ff2 JF MATCH A^B 

[8] -►ill JF MATCH A-t-B 

[9] 'SORRY !,B1,* T/Py AGAIN.' 

[10] /PffilCff 

[11] ■*R2 IF MATCH A^B 

[12] 'THATS STILL NOT RIGHT. THE ANSWER 

IS • ;i4xB ; • TRY THIS ONE. • 
[13] ->C 

[14] i41: 'rOf/ ffil^ff ADDED. TRY AGAIN.' 
[15] -t-LASTREAD' 

[16] R2:'THATS RIGHT '.Bl,' ffOJ/' 
[17] Cf?12 

[18] 'fcWiir rJA/ffS •;B;*J5 TO •;BxC; 

[19] i?F4Z7iV 

[20] -*-/?3 JF il/iirCff C 

[21] 'SORRY, THATS NOT RIGHT, TRY AGAIN. 

[22] READN 

[23] -♦/?3 JF MATCH C 

[2U] 'rayir IS STILL NOT CORRECT. THE 
RIGHT ANSWER IS 'id' TRY THIS.' 
[25] -K? 

[26] R3'.' RIGHT ',B1,' NOW,' 
[27] -^Q 

[28] STOP 'MULTIPLY' 

7 ' 



FIGURE U 
i4 SIMPLE DRILL 
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noisy 2741 communications terminal • it is hoped that the 
manufacturers will soon produce equipment which can handle 
the x\PL character set. In the meantime^ software support 
for teletype ports can be implemented. Although this is not 
entirely satisfactory for those who want to use the full 
range of APL characters^ it is a very acceptable solution 
for the Computer Assisted Learning program which seldom 
requires more than the normal character set. We plan to 
experiment with a number of the very small portable 
terminals which can be taken home and hooked up to the 
television set and the telephone so that the student can 
actually do some of this material at home- provided he can 
negotiate for the use of the television and the telephone 
for the required period of time* 

Many of the systems which were designed specifically 
for CAL have facilities for light pens^ audio 
playback^ slide projectors etc. APL can be used to drive 
such devices as well when the need arises. XY plotters can 
easily be interfaced with the system, and in the Oranae 
Coast College District they are successfully running random 
access microfiche devices capable of accessing any one of 
48,000 slides in less than four seconds. Such devices will 
undoubtedly cut down on the cost of storing highly static 
literal information and make the use of pictorial 
information very feasible. 

There are a few difficulties with interfacing APL with' 
graphics terminals at the present time, but there is a very 
active program at the University of California at Irvine 
to explore these possibilities. One of the difficulties we 
found in one of the CRT terminals was that attempts to 
underline letters simply erased the letter and left the 
underlining. Moreover, graphs slowly disappeared off the 
top of the screen as the lesson progressed line by line, so 
it was not just a simple matter of taking over the lessons 
which had been writtc^n for the hard copy typewriter 
terminals into the CRT format. There is no doubt that 
students do like to take the hard copy from a lesson away 
with them, so it may not be too wise to press too hard for 
the display-only terminal . 

The ultimate terminal will of course contain a great 
deal of local buffer storage so that special character 
sets can be transmitted down the line, stored locally and 
accessed with 8 bit codes or less* This feature or 
something close to it is already available in the PLATO IV 
terminal. Ultimately, it should be possible to transmit and 
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Store locally the entire information necessary to display 
colour pictures. A hard copy facility right at the terminal 
should also be available. Such terminals are undoubtedly a 
few years off but not that far away. Certainly the 
technology is available today but we still have a lot to 
learn about how best to use it and how we should be 
packaging material even for the terminals we have available 
today. How does one take into account for example, the vast 
range of responses on the part of the students when the 
computer calls them by name? We think that we can make 
some progress along these lines even with the rather 
limited equipment that is available for APL right now, and 
perhaps we can even learn a little about how the terminal 
of the future should be designed to make it most effective 
as an interface between the user and the computer-data 
bank . 



COSTS 



The criticism which is most often levelled at computer 
assisted learning is that it costs too much and that we 
cannot afford it even if it were effective. It takes a 
great deal of time and effort to write good lessons and 
even more stamina to keep them up to date. Moreover, 
computers are costly things to run and electronic storage 
of information is more costly than books. 

The usual answer to these criticisms is to point out 
that the cost of electronic information processing is going 
down By a factor of ten every seven years while people are 
becoming more expensive. I do not believe that CAL will 
replace human interaction in the learning process but that 
It will have a valuable role to plav if we can find out how 
to use It properly, it is therefore essential to have a 
9ood idea of its cost and to realize that there will have 
to be an initial stage of experimentation during which it 
will certainly not pay for itself. Nevertheless) it was 
surprising to me to learn just how little our system costs 
even at this stage and it is very easy to see in the near 
future, developments in terminals and computers which will 
bring this cost down dramatically. 

It has been estimated that the PLATO IV system at the 
University of Illinois will cost less than one dollar per 
student hour including terminals, royalties, computer and 
storage. At this rate, CAL is quite competitive with 
conventional teaching costs even at the elementary school 
level. In our system, the terminal we presently use rents 
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for $105 per month. The telephone costs $15 per month. The 
present charge levied by the University of Toronto 
Computing Centre is $3 per hour connect time and $3 per CPU 
minute which our experience indicates comes to about $4 per 
hour for CAL . If the computer terminals are used for 150 
hours per month, the total charge is less than $5 per 
student hour. The computing costs are allocation dollars at 
present and it is felt that the price is somewhat inflated 
•at the present time, in fact , we have a special rate with 
a commercial firm which amounts to much less than this if 
the port IS used 150 hours per month. 

The cost of terminals will soon be reduced by a factor 
of at least 2 and possibly 5. If we assume that the 
minimum cost will be about $50 per month including 
servicing, and that the terminals are used on the averacre 0 
hours a day for 300 days of the year, the cost of " the 
terminal xs then 25« per student hour. It is difficult to 
assess the costs of the computer since the one we are using 
is now an old model, but it is supporting three interactive 
systems at the present time. A reasonable figure might be 
about $120,000 per year which comes to 50 « per' student hour 
If on the average, one hundred terminals are supported. 
Communication and lesson costs must be added but it 
certainly appears as if the cost could be below $1 per 
student hour. v 1=^- 

Another feature of this system is that it can be used 
for a number of other things. For examule, we are 
developing an interactive student information system so 
that the terminals can be heavily used by the Registrar's 
Office during registration and then moved out for CAL 
during the rest of the year. Terminals could also be 
provided for staff to write lessons, keep records, place 
orders, etc. if the system can be used to explore a number 
of ways m which interactive computing can be useful in the 
further^ environment, then the cost is spread even 

in any case , we feel that the cost we are presentlv 
bearing is one which we can afford in order to explore cal'. 
It is interesting to note that this whole project has 
received no outside support at all and that it has been 
built up by concentrating on CAL. itself and not on the 
hardware or assembler level programming. 
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In conclusion, we have no regrets for having chosen 
APL as a base on which to build our CAL system. This 
powerful interactive language has allowed us to do 
everything we have wanted to do so far and it is 
interesting to note that our system could do almost 
anything specified in the taxonomy circulated by the 
National Research Cotincil of Canada. The cost calculated 
for high levels of usage appears to be competitive with 
specially designed systems and the system can provide 
excellent response time for large numbers of users, our 
experience indicates that a thorough study should be made 
of APL to determine why the system can provide such low 
cost and response time, benefits which we did not 
originally anticipate. 
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CAL LANGUAGE STANDARDS SESSION 9C 

By/Par: J.W. Brahan, ROOM/SALLE 1A5 

National Research Council of Canada 

Instructional applications of the computer have resulted in the development 
of many specialized high level programming languages, each one aimed at providing 
effective access to the computer by student, teacher, course author, and/or researcher* 
At any given installation, the benefits to be gained from such a language are quite 
evident. However, the variety of such languages iJhich has evolved has resulted in great 
difficulty in exchanging CAL programme materials among different institutions. Thus 
much effort is expended on development of software which exists elsewhere, but not in a 
form suitable for the particular computer installation at the institution wishing to 
make use of it* 

A common programming language for CAL applications would represent a major 
step towards permitting exchange of CAL software between different computer installations . 
To be effective, such a language must take into account the variety of approaches used 
in instructional applications of the computer. It must consider the requirements of users 
with a variety of skills. It must include provision for the utilisation of a wide 
range of specialized input-output devices required to permit effective communication 
between the user and the computer. As with all standards, provision must be made for 
the CAL language standard to be updated in order to respond to changes in user requirements. 

The development and maintenance of standards for programming languages requires 
the cooperation of the user, the equipment supplier, and the researcher. As a first 
8te£ towards arriving at. definition of user requirements for a CAL programming language, 
the NRC Associate Committee on Instructional Technology convened a working panel whose 
members have participated actively in a variety of CAL application, with a variety of 
programming languages involved. The task assigned to the working panel was the definition 
of a functional specification of a programming language to meet user requirements. 
To arrive at a standard from the functional specification requires the production of a 
detailed specification followed by implementation at a number of centres. This implemen- 
tation stage must be completed out before one can say a standard truly exists, since a 
standard has very little meaning to the user if he cannot apply it. 

NORMES PES LAKGAGES EAO 

.^,„ applications pgdagogiques de I'ordinateur ont conduit au dSveloppement de 

beaucoup de langages de programmation specialises et d'un haut niveau, chacun ayant pour 
but de permettre ^ I'gtudiant, au professeur,^^ I'auteur de cours et ;iu chercheur d'avoir 
accSs a 1 ordinatcur de la manilSre la plus efficace. Les avantages obtenus de ces 
langages, a n importe quelle installation, sont gvidents. Cependant, la diversite de 
ces langages, qui ont evolues, est I l^origine de la grande difficulty d'echange entre 
etablissements se servant de programmes EAO. Ainsi, on depense beaucoup d'ene'rgie pour 
developper une programmation dej^ existant ailleurs mais dans une forme qui n'est pas 
appropriee ^ l^ordinateur de tel ou tel etablissement desirant s'en servir, 
o^ ^ ^ u "^""^ langage de programmation permettrait de vraiment faire des progrJis 
dMn!f.Ti f?^^"" de programmation EAO entre etablissements disposant d'ordinateurs et 
diSrfnl ? differents. Pour etre efficace, ce langage doit tenir compte des 
en WmL^h! '''J'k.w'?"^^' applications sont envisagees. II doit etre con^u 

J possibilites des etudiants. II doit comprendre des dispositions 

sScHh!!! ^'utilisation d'une large gamme de dispositifs d'entree et de sortie 

fauf nrfndr.T'' S^""^\'^f relations efficaces entre I'usager et I'ordinateur. II 

fiw rnLn J In J'^M '^''''".T^ '^^Sage EAO, comme toutes les normes, 

Solent mises I jour afin de s'adapter aux nouvelles situations, 

une cooDer^if^!n^rr?t" \tenue ^ jour de normes de programmation necessitent 
une cooperation entre I'usager, le constructeur des machines et le chercheur, Un 
drS^LS?Lr"-i' ^^^oins de I'usager a^te fait par le Comite associe 

de technologie pedagogique du CNRC qui a convoque un groupo de travail ayant narticloe 
nJLrZ::^ pedngogiques en se'servanf d/langageTdik'renJ 

progranflnation, Co groupe devait deflnir les param^tres fonctionnels du lancaee de 

S"LT5e " T/^'f.r' uthisateurs. Pour obtenlr dL Sn'es on 

partant de ces definitions, il faut d'abord detainer les elements du langage a niettrc 

l*orn,H ^^"^ "^^^ ^^^^^^ ^^^^ ^^^^ ^'^'ineo avnnt que 

Sour l"^M^^^^i?^^?^" ^""^ ^^^^f'*^ reellement, car la uorme a pen de signification 

pour 1 utllisateur s'il ne peut pas I'appliquer. 
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•4. T!?® ° °^ adequate standards in any field makes 

It difficult to select equipment without fear of premature 
obsolescence, makes it almost impossible to effectively 
compare alternative choices, results in higher costs to the 
consumer and, in general, is a major barrier to the 
effective exploitation of the available technology. 
Standards permit the transfer of knowledge and equipment 
from one group to another. They provide for effective 
training of workers; skills which are based on standards 
have a wide range of application. Some measure of the 
importance of standards is indicated by the fact that more 
than 1200 standards have been approved by the Canadian 
Standards Association. These cover an extensive range of 
topics, with each standard representing a general agreement 
among maker, seller and user groups as to the best current 
practice with regard to some specific problem. 

« Standards are particularly important in fast 

growing technologies such as the computer field, where the 
capital investment required can be very large and no 
organization can afford to isolate itself from the general 
community by adopting non-standard practices. In such fast 
growing areas, it is important that standards be introduced 
as soon as requirements can be adequately defined and the 
solutions to these requirements tested sufficiently. One 
could say that these standards are introduced in anticipa- 
tion of wfdespread application, but in many cases, these 
applications could not take place without the existence of 
the standards. 

Computer Aided Learning is one field which is 
very much dependent on standards if it is to result in 
extensive and effective use being made of the computer. Of 
particular importance is the need for standards to permi', 
the transfer of computer-based materials from one organiza- 
tion to another without the necessity of an expensive 
reprogranuning operation. Compared to other instructional 
materials, computer-based materials are expensive to 
develop and, in general, must reach a wide audience if they 
are to be economically viable. 

One means of improving the "accessibility" of a 
computer system to users who are not computer specialists 
is through the use of so-called high level programming 
languages, whose characteristics are tailored to certain 
specific applications. The widespread use of languages 
such as FORTRAN, BASIC, COBOL, etc., attests to the ' 
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effectiveness of this approach. This same approach has 
been applied in the field of Computer Aided Learning, The 
result in this case hz,B been the development of many 
specialized high level programming languages, each one 
aimed at providing effective access to the computer by 
student, teacher, course author and/or researcher. When 
one considers any given installation, the benefits to be 
gained from such a language are very much in evidence. 
However, the variety of such languages which has evolved 
has resulted in a major barrier to the exchange of CAL 
programme materials among different interested institutions. 
As a result, much effort is expended on the development of 
software which exists elsewhere, but not in a form in which 
it can be utilized on the computer installation of the 
organization wishing to make use of it. 

Let us consider briefly, the conditions which 
should exist in any field before the development of a 
general standard is indicated. Obviously, there must exist 
a need, either immediate or future for the function which 
the standard defines. There must also be an indication 
that there will be broad application of the standard. 
Finally, there must be an indication of interest in the 
activity on the part of suppliers of equipment. 

Some indication of the extent of activity in 
Computer Aided Learning is provided by an examination of a 
catalog of computer based instructional materials, pre7. . 
pared by Helen A, Lekan of the University of Wisconsin , 
It should be noted that the 1970 edition of the publication 
has been used so that specific data applying to any given 
programming language should not be considered current. 
There have been several new CAL programming languages 
introduced since the catalog was published and some are no 
longer available. However, the following data which have 
been derived from the catalog are indicative of the general 
situation which currently exists* 

The publication lists a total of 96 organizations 
interested and actively engaged (a few of those are indicated 
as being in the planning stage) in various aspects of 
Computer Aided Learning, Of the 96, 87 are U,S, 
organizations; thus the data are primarily derived from 
activities in the U,S, 

An indication of the range of application areas is 
provided by the catalog's listing of entries by subject 
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matter which includes 55 subject categories. As one might 
expect, progranunes in mathematics lead the list with 216 
entries out of a total of 912. However, it is interesting 
to note that programmes in the health professions (79) are 
third most plentiful in the catalog, immediately following 
those dealing with computer operations and programming. 

An indication of the number of computer manu- 
facturers and variety of equipment involved is provided by 
the catalog in a listing of programmes by central processor. 
This list includes 53 different computers from 15 different 
suppliers. The distribution is presented graphically in 
Fig. 1. n IT J 



These data would indicate a situation which would 
benefit from the adherence to standards as much as possible. 
However, when we examine the situation in regard to 
programming languages, we find that there are 54 different 
programming languages listed as being used, it should be 
noted that not all of these are high level languages, a 
few are assembly languages. Many of these languages have 
only one or two entries in the catalog. However, the 
number of languages which have been used to produce a very 
considerable amount of course material is greater than one 
would expect to be acceptable if exchange of such materials 
IS considered desirable. A ranking of programming languages 
by number of programmes reported is illustrated in Fig. 2 
while the number of institutions using a given programming 
language is shown in Fig. 3. it is interesting to note 
that several of the languages which are in use at only one 
institution have been used to generate more programmes than 
some languages which are in use at several institutions. 
The outstanding example is the TUTOR language which is used 
only at the University of Illinois PLATO project. One 
hundred eighteen programmes are listed as being written in 
TUTOR compared to 43 CAL programmes in FORTRAN which has 
entries from 17 institutions. Perhaps some indication of 
the effectiveness of a language for CAL applications can be 
obtained from the number of programmes per installation 
of the language. 

In Canada, we cannot lay claim to 54 different 
programming languages being used for CAL applications, but 
considering the smaller number of institutions involved, 
the variety of specialized programming languages in use is 
rather surprising and an effective barrier to the exchange 
of course materials. A list of some of the languages being 
used IS shown in Fig. 4. = ^ ^ 
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Benefit-s are to be gained from the exchange of CAL 
programmes bc\h at the research level and at the application 
level. At the research and development level, the exchange 
of programmes permits more effective development effort by 
eliminating the duplication of work which often results 
because materials cannot be exchanged. At the production 
and application level, the exchange of programrne materials 
spreads authoring costs over a much wider "market" than is 
otherwise possible. More effort can thus be etrpended on • 
programme development and evaluation, with the result being 
a higher quality and more economical product. However, if 
the variety of programming languages being used for CAL 
applications continues to increase, and an effective means 
IS not found for exchanging computer based materials, these 
materials will continue to be considerably more expensive 
than they might otherwise be. Materials which might be 
economically viable if they were to reach a large audience 
could be far too costly to consider using for the small 
audience resulting from the fragmentation caused by the 
multiplicity of programming languages. 

Two approaches can be considered to provide a 
means for the exchange of computer based course materials. 
One could be considered an "individual solution" and the 
other a "group solution" to the problem. 

The individual solution is represented by the use 
Of translators. Thus a given installation would use one or 
possibly two languages for CAL applications and translate 
programmes written in other languages. It is technically 
feasible to produce programmes which will translate from 
one computer language to another automatically, or at least 
semi -automatically. However, certain problems can arise in 
attempting to use and maintain such translators. In 
general, the user must be familiar with both the source and 
destination languages to make effective use of the 
programme material. The translator programme must reflect 
changes introduced in the languages with which it is 
concerned. From the practical considerations, it is un- 
likely that any installation could deal with more than a 
few languages in this way. Finally, the approach has iittle 
influence on the number of CAL programming languages either 
present or future, in spite of these drawbacks, the use of 
translator programmes does represent a practical means for 
transporting course materials from one installation to 
another in that it can be implemented relatively quickly. 
However, it is suggested that this approach should be 
considered, at most, an interim solution and a solution 
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should be sought which resolves more completely the 
problems. 

The' so-named "group solution*' to the problem of 
exchange of materials is based on the existence of a 
programming language common to a large number of different 
installations and common to a number of different machines. 
To achieve the development and implementation of an 
effective common programming la:iguage for CAL is not a 
simple undertaking. It requires the continuing cooperation 
of users at all levels, and of equipment suppliers. 

As a first step towards arriving at a definition 
of requirements for a CAL programming language, the 
Associate Committee on Instructional Technology convened a 
working panel with the task of defining the functional 
specifications of such a language. The members of this 
panel have participated in a variety of CAL applications 
involving a variety of programming- languages. Experience 
of the panel as a whole involves applications of all of the 
programming languages listed in Fig. 4 as well as applica- 
tions involving translation from one language to another. 

The functional specification (2) produced by the 
working panel has recently been approved by the Associate 
committee for publication in order to receive critical 
comments in respect to its anticipated implementation as a 
national standard. 

It is expected that the report will be available 
for distribution in early July. 

It is not the purpose of this paper to describe 
in detail the requirements of a CAL programming language, 
but some of the important general characteristics are worth 
considering briefly. 

Of particular importance in any high level, or 
problem-oriented language, is that it provides effective 
access to the computer for the intended user. It is not 
sufficient to incorporate in a language very powerful 
features, but implement them in such a way that the user 
has to be a mental contortionist to apply these features. 
The features of the language should ba readily accessible 
to the novice user, but at the same time, the language 
should be sufficiently rich that it does not limit the 
experienced programmer. 
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For CAL applications, extensive features are 
required in the language for accepting and processing user 
input and for controlling the presentation of information. 
Glaser, Ramage and Lipson have carried out an extensive 
study of the interface requirements for teaching elementary 
mathematics, reading and science. (3) Their findings 
indicate the need for extensive input-output facilities in 
all three of these areas. Any CAL language must take into 
account these requirements dictated by subject matter, but 
must tlso give consideration to user requirements. The 
user may be, for example, a young child who cannot read, or 
he may have a perceptual handicap requiring special input- 
output facilities. Thus the language must be capable of 
coping with a wide range of input-output devices and provide 
the user with effective access to these devices in a variety 
of applications. - ^ 

The language must provide sufficient facilities 
for the gathering and analysis of data which is generated 
as a result of applications. Such data iTtay be used for 
on-line adjustment of programme logic, or they may be used 
for off-line analysis of student and course performance to 
provide measures for evaluating and improving programme 
materials. 

Very much of importance is the requirement that 
the language be structured in sjch a way as to promote 
built in documentation. It is a fact of life that .tianv 
programmes are written with the intention of adding explan- 
atory comments at a later date which never arrives. The 
result .is in many cases a programme whose logic is readily 
understood only by the original programmer and even he may 
have difficulties if he has not been working with the 
programme for some time. However, some programming 
languages are structured in such a way as to promote built 
xn documentation, which, with the addition of relatively 
few explanatory comments results in a programme readily 
understood by potential users. 

A requirement for Canadian applications is that 
the language have a structure such that programmes can be 
written in both English and French. This implies equivalent 
commands in the two languages, but also coded character sets 
which cater to the special requirements of information 
interchange in both languages. This is not to imply that 
there should be automatic translation of course materials, 
but it shoulc". be possible to run a course written in French 
on a system which is primarily used for courses written in 
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SliwMiau" """" '"P"' processing functions 

programming language is to continue to 
remain valid, it must be caprble of being updated to 
t^^in L^'^o "^^^jeq^i^ements and to permit advantage to be 
taken of new technological developments. Such updating 
must be introduced in a manner so as not to invalidate 
materials previously prepared using the language. 

reanir^^ r.V^^^ ^""^ ^""-^ °^ "'^ general characteristics 

it^?s hnnSJ a programming language for CAL applications, but 
It IS hoped that they are sufficient to indicate the 

?nwo^w^i^^ language and the problems which will be 

involved m its development. 

T.r,^,,. The functional specification for a Common CAL 
Language which has been prepared by the Associate Committee's 
working panel is but a first step in the process of ^rivfng 
at a suitable language standard. The next step is the 
KrucSj;°o/fH^ detailed specification to define the fine 
sSou?r^^ S the language. This detailed specification 
should be based m whole or in part, on a currently existino 
language If one exists to satisfy many of the requirlmeSs 
defined m the functional specification. There is no pSnt 
xn developing the equivalent of what already exists. ?he 

^P^^^f^c^tion must be followed by implementation of 
the language at a number of centres, until this implemen- 
^^^r reached, one cannot say that a standard 
Lf^^fJ^,: ^^'"''^ standard has very little meaning to 
the user if he cannot apply it and is forced into using 

oFa SnmLn^^;''^^^''-^* ""^^ implementation and maintenance 
of a common programming language for CAL applications will 
require the continuing cooperation between the various 
users, equipment suppliers and research groups. Without 

lilnilTfiri'dZkrT'' ^""^ ""^^ °' achievtnfa 
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Number of I nstollotions Reporting Use 
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CAL Programming Languages 
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Interactive Programming Languages Adapted 
for Specific Instructional Uses 



Karl L. Zinn 
University of Michigan 



Some of the text is adapted from presentations at the OECD Seminar 
on Computer Sciences in Secondary Education held at Serves, France. 
March 1970, and the First International Conference on Man-Machine 
S^^fo^J^""' ^^'i'ii^gton, England, September 1970. Ideas proposed in 
the 1970 statements are repeated here as realities of instructional 
software on the Michigan Terminal System in 1972. 
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INTERACTIVE PROGRAMMING LANriTAnES SESSION in 

Centre for Learning & Teaching, 
University of Michigan. 

system effort. Durine Dreoaratlon «nH »vL c '®^P°"" °^ the user to the 

the casual and iSJequenrSser specS l.nTflT f ' ^"S^""' responsiveness provides 

algorithms. benefits of procedure writing and testing of 

instructioifrinSiJo'iL'nrwnl bf :escri^5"n":jJch%H'"f "^^^ ^ 
builds upon task-relevant feat.rL . ^ ^ "'^ teacher or lesson designer 

various levels of "se^ For e^amnL Jh f'l^ access at 

or Simulation can b:c;™e'the "iS ructo^'^hers. tL^^ ' computer-based game 

student, and the instructor can I " t ^ "^'^ exercise for another 

the learning games were based! researcher" exploring the models on which 

^ LE LANGAGE INTERACTIF DE LA PROGRAMMATION 
ADAPTfiE A PE S UTILISATIONS PRECISES DANS L'ENSIEGNEMENT 

U contribution essentielle de I'utilisation de I'ordinateur interactif 
iaplique la rSponse: une rSponse aux efforts de I'usager pertinente i ses besoins 
et a son experience; des dispositions pour 1' encouragement de la rSponse efficace de 
1 usager i 1 effort dusystJme. Pendant la preparation et I'exScution d'un programme, 
la rgponse foumit Jl I'usager fortuit, qui ne s'en sert qu'i I'occasion, des avantages 
spficiaux d'Scriture de procSdS et d'essai des algorithmes. avancages 

A' 4 ^""^^^ douzaine de langages de programmation interactifs, 

on decrira un environnement enseignant oQ le professeur ou I'auteur de la lecon, base 
l''acc6s"''Hrf?^''!?[ «'«%"""«'^istiques pertinentes S la tSche et peut ouvrir ou fermer 
»tr ; t ] ''V''^*"' ! niveaux d'usage diffSrents. Par exemple, un Studiant qui 
est en train d apprendre au moyen d'un jeu ou d'une simulation a base d'ordinateur 
peut devenir le professeur". au moment d'Stablir un nouvel exercice pour un autre ' 
hilt ill T P"^"'*"'' P*"' 1« "chercheur" examinant les modSles formant la 
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The essential contribution of interactive computing involves 
responsiveness: a computer should respond to the efforts of a user 
in a way which serves his goals and recognizes his needs and background; 
and computing procedures should encourage effective response of a user 
to the computing done for him. During preparation and execution of 
a program, responsiveness provides the casual and infrequent user 
special advantages for writing procedures and testing algorithms. 

After a brief review of a dozen interactive programming languages, 
an instructional environment is described in which the teacher or 
lesson designer builds upon task-relevant features and is able to open 
and close student access at various levels of use. 

Availability of Languages 

Interactive language processors have a short history, although 
console use of small machines kept alive the idea of interactive 
tracing and debugging while large computation centers were completely 
dependent on batch facilities. 

It has been about eight years since RAND Corporation made JOSS 
(Shaw, 1964; Bryan and Smith, 1967) available to its scientists. 
Initially it was an experiment in "open-shop" service for simple 
con5)uting needs and used an old computer no longer considered of 
value for research users. It brought convenient computing power 
into professional offices, and was characterized in the mid-1960 's 
as a major fringe benefit of working for RAND Corporation. Ready 
acceptance by users and favorable impact on working habits have been 
characteristic of conversational computing. 

TELCOMP, a derivative of JOSS prepared at Bolt Beranek and Newman 
(Meyer, 1966) , has been used with considerable success by elementary 
school children for individual exercises in mathematics and sciences. 
TELCOMP and its descendats STRGCOMP (Bolt Beranek and Newman, 1968) 
and ISRCOMP (Feurzeig and Papert, 1969) continue to be used for 
programmer training at all levels, and for student exploration of 
mathematical concepts. 

LOGO found its initial success in teaching fundamentals of 
mathematics to children about 12 years of age (Feurzeig and Papert, 
1969) and the current emphasis of its originators is on teaching 
young children to think (Papert, 1970; Papert and Solomon, 1972). 
It is now being adopted by a number of other research projects for 
development of environments for learning. 
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BASIC built a reputation on early success at Dartmouth College 
(Kemeny and Kurtz, 1967) and throughout GE time-sharing service centers. 
The name and most of the language features were adopted by other 
manufacturers and time-sharing services, and now standardization has 
become a concern (Ogden, 1971). 

APL (Falkoff and Iverson, 1968), built upon the notation proposed 
by Iverson (1962) in his book A Programming Language, has been applied 
by different users to various tasks, including student problem solving 
and simulation. For at least some computer-assisted instruction 
projects it has replaced COURSEMRITER for programming tutorial as 
well as simulation exercises. 

Much of the enthusiasm for conversational computing languages may 
relate to non-essential features; the quick response and understandable 
diagnostics of these on-line systems have been provided in batch 
systems. BASIC is often used as a remote entry batch system. The 
Illinois Institute of Technology has for some time serviced a network 
of school and college users with good results at very low cost using 
IITRAN (Dewar and others, 1969) for remote-entry batch (along with 
a desk-calculator- type interpreter called CALCTRAN).. 

Now that commercial services and small dedicated systems are being 
offered to (and purchased by) schools and colleges, it becomes 
increasingly Important to isolate the iissential contributions of 
interactive programming languages, and to determine effective cost 
conditions. 

Computer systems dedicated to ;'nstruction Uses in a tutorial mode 
cost between $2 to $12 per user hour at a console (or user station). 
The estimates depend on assumptions about the number of simultaneous 
users which can be service with adequate response time, the number of 
effective hours of use per day or per year, the years of operation 
of the system, the amortization of software costs^ etc. Convenient 
means for presenting static, graphic images generated in real time 
by the computer can add considerably to the cost, although graphics 
will be much less expensive in the near future. 

Small systems dedicated to problem solving use of a simple 
interactive programming language cost from 25c to $8 per user hour 
at the terminal. Again the values depend on the expectations of the 
buyer for effective use of the system, that is, number of simultaneous 
users which can be supported, effective hours of use, amortization, 
etc. Commercial time-sharing services range from $5 to $35 per hour, 
depending in part on the particular means of accounting for elapsed 
time connected to the computer system, central processor time, channeJ 
use, and storage. Incidentally, a user with access to two or more 
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systems sometimes can extend his computing dollars by matching his 
problem demands to billing techniques. For example, he would run 
compute-bound jobs on the system billing only for time connected, 
and carry on conversations making heavy use of the terminal and 
input-output channel on the one emphasizing central processor time 
in the billing. Of course the differential advantage will be reduced 
as many users take advantage of the differences in billing procedures 
from one company to another. I • « * ' - 

Desirable Features for Interactive Use 

Part of the success of interactive programming can be explained 
by the ease with which the languages are learned and initially used, 
whether in batch or conversational mode. FORTRAN compilers ^ave 
presented a difficult hurdle for the uninitiated; a new user's first 
attempts to specify input lists, output formats and conditional 
branching can be frustrating. JOSS has a small number of statements 
and considerable consistency throughout; this simplicity (or elegance) 
facilitates recall and use of statements in the language and is 
impressive when seen in interactive mode. Much of the advantage could 
be achieved with a similar convenience available readily through a 
batch-oriented system having a response time which is suitable for 
the learning and practice task involved. 

The essential contribution of the interactive mode of work must 
involve responsiveness of the system: relevant reaction to the 
efforts of the user; and provisions for encouraging effective response 
of the user to the system effort. Responsiveness of a processor 
during preparation and execution of a program is a key for the casual 
and infrequent user to unlock the special benefits of procedure 
writing and testing of algorithms. For example, the occasional user 
is well advised to try an idea (an expression, an untested subprocedure. 
or a new output format), even though only partly formulated, and let 
the computer show him how much can be processed and what the results 
might be. Furthermore the processor can "guess" at what the user 
intended, begin executing the instructions, and accept an interruption 
and clarification as soon as the user recognizes that the procedure 
should be changed. 

When diagnostics are provided at the moment when needed and backed 
up by references to readily available literature, one can relieve the 
user of unnecessary concern for detail of the means to describe his 
procedure; one hopes he will give more attention to solving the 
problem. A shorter elapsed time between problem definition and 
solution, and the time saving attritutable to continuous working 
sessions provide a bonus. 
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Interactive prograannlng languages incorporate aids for program 
testing in a very natural way. The sane statements with which stored 
programs are written can be used as direct comnands to print the 
values of selected variables to see what went wrong, assign new values 
to test other parts of the procedure, and resume execution with any 
line or segment of the program. 

On-line conversational tise of computers is almost certain to be 
more costly than less glamorous means of access to information 
processing aids. However, the occasional user of computers is more 
likely, to benfit from the interactive mode of operation than experienced 
or frequent users. Programming languajges and learning exercises 
should be sleeted to take advantage of opportunities for the infrequent 
learner-user to carry on a dialogue with the system. His attitude 
toward computers and their uses in his discipline may at times be as 
important as his particular accomplishments with the specific content 
skills to be learned. 

Authors of computer-based learning exercises, although their 
primary task is instruction and not programming, probably benefit 
from all of the advantages listed above. The computation facilities 
of the interactive languages are useful in many computer-based 
learning exercises, and convenient computation is conspiciously 
absent from nearly all languages specially designed for computer- 
assisted instruction. When an author uses an interactive language 
the program is more accessible to the student. This increases the 
opportunity for a student to become involved in the redesign of an 
exercise, and this is especially Important when the curriculum writer 
has incorporated mathematical models or simulations. 

Extension into Other Disciplines 

In order to build a proper problem-oriented language for many 
subject experts to use in a variety ot tasks such as building models 
and embedding them in pedagogical situations, the language Itself 
ought to be extendable in some way through macros, subroutines, or 
statement definition capability. 

One suitable means for extending a language also provides additional 
capability for servicing a variety of users, and shifting a user among 
different modes. Additional features should be implemented as another 
level x>f operation in the same language system, and facility should be 
provided for opening or closing access to the various levels defined. 
For example, the student learning from a computer-based game or 
simulation can become the "instructor" when setting up a new exercise 
for another student; the author can become a researcher exploring 
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models on which his learning games are based; even the applications 
programmer can become a "systems" programmer, if he can move from the 
level of programming in a given language to the design of new language 
features. 



The system designer (or an experienced programmer) can on the 
basis of discussion with a subject expert add to the language those 
statement types which service the particular needs of the problem. 
The subject expert should find thitf second-level notation convenient 
for building models and for «mbedding them in a suitable learning 
situation. Of course he may delegate this task to a writing assistant 
or programmer. The student user of this system works at a third level, 
interacting with the model at first only through the abstract simulation 
as a management game to be played. The les«on designer provides the 
student with a means to "unlock" the features of the processor by which 
the model may be manipulated in simple ways, and the student may 
explore its parameters and perhaps arithmetic expressions and logical 
conditions. At this point a student will be permitted to move down 
to the 2«d level, that of the author or subject expert; here he may 
design entire models or simulated sittiations. Whenever the task- 
oriented features of the language are not adequate to the model building 
and testing, the experienced programmer is again called in to extend 
these capabilities to meet the needs of the discipline-oriented 
users . 



This conception can be represented in part by an arrangment of 
successive shells with permeable boundaries. The system configuration 
lies at the center of the sphere, and the system programmers build 
up a shell around it to make useful functional capabilities accessible 
to applications programmers. They in turn produce the routines and 
packaged procedures which provide convenience and power for the 
discipline-oriented user, who may then adapt these task-oriented 
procedures for convenient use by students in suitable pedagogical 
content. The outer three or four levels are the ones of primary 
concern in this paper: instructional use; discipline-related packages 
and applications programming; and modification of the processor 
and system features. 

Because of the variety of instructional strategies, intended 
learning outcomes and writing habits, it is not feasible to include 
all the desired aspects of this multi-level situation in a single 
language. More appropriately one works within a system which provides ^ 
the necessary building blocks and the means for linking them together 
Into individualized versions of a processor or package of processors. 
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Desirable Properties of an Instructional Progranning Language and 
Operating System 

The actual components In the operating system and. processor are 
lii?)ortant to this discussion only as a general user might see them. 
Nine points follow. 

1. Rapid response to trivial requests. For example, file 
manipulation, simple calculations or operations should be performed 
with no noticeable delay. 

2. Retention of programs and data for the convenience of the 
user. During explorative execution of tasks the user should be able 
to return to any earlier state; when he concludes a working session 
he should be able to save the program and data for restarting (in the 
same state) at a later time. 

3. Simplicity, conciseness and precision in notation. Typing 
a large number of characters is annoying to any serious user and 
leads to errors. The medium of communication between man and machine 
should be straightforward. 

4. A suitable vehicle for programming. A sound design should 
encourage the user to derive a pxx>blem solution in terms which 
produce effective programs. 

5. Notation to record algorithms clearly. A medium of 
communication among program writers and users should be possible • 

6. Convenience in a variety of applications. The value of 
the language is Increased by the number of diverse applications a 
single user may pursue. Although the designer cannot anticipate 
everything a user might want, be should try to provide the elements 
from which anything of which the system configuration is capable 
can be called upon in a convenient way. 

7. Complete determination of the environment. The designer of 
a working environment must be able to specify handling of all events 
during interaction. He must be able to "recover" in spite of student 
errors, and even analyze those errors in order to restart in a useful 
state. I 

8. Control of the working environment with "protection." The user 
is in control or can recover It from the computer, although the system 
protects the user from errors such as accidental elimination of file 
records. 

9. Relevance of the envlronuent for work. The services of the 
computer installation should be available in some reasonable manner, 
e.g., acquiring various storage media, accessing one or another 
processor language, linking processors through common data files, 
editing, tracing, testing, etc. 

The dialogue between teacher and student (or between scholar and 
data) is central to the learning environment; conventions for describing 
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input and output should be convenient. Various devices must be 
accessed, including special-purpose terminal equipaent for science 
experiments or artistic composition, and secondary storage such as disk 
files to hold large data bases on the topic being studied or to record 
detailed records of student performance. Rapid data rates are required 
for topics requiring extensive and dynamic graphics. Format conventions 
should allow options specified by the lesson designer, e.g., to control 
the position of the carriage or cursor both for reading and writing, 
and variables by which formats are generated dynamically to extend 
the designer's control of the working environment on the typewriter 
page or display screen. Complexity of input-output processing should 
be determined by the user's intentions and his competence with the 
language and system. 

The manipulation of files is common in a problem solving 
environment. File-handling statements should be executable in the 
same way an assignment statement is. Essential functitins are: 
listing; manipulation (searching and editing); designation of access 
(read-only, shared, write-only); and determination of type (sequential, 
indexed). Interrupts are an Important consideration, with some 
handled automatically for convenience, but others left to the control 
of the designer of the working environment. He will interrupt to 
help the user recover from language and system features not yet 
understood, and perhaps interrupt at other times on the basis of 
how much time the user has spent or some other condition. Control 
of interrupts also allows the system to respond to student users directly 
for example, for evaluating expressions. 

Programming a machine to respond usefully to a student's 
constructed command or comment requires a great deal of data handling. 
A facility for describing and manipulating a variety of data structures 
IS essential if the language is to be flexible enough to encompass 
a variety of applications. Presently languages have only primitive 
methods for the description of data; current means for manipulation 
of data structures are also quite ctxxiti. Contributions of computer 
science to the study of different data structures have not made 
implementations any more available to the non-professional. Nevertheless 
much that is done in computer-based learning environments requires 
transforming and accessing information which entails a data description 
indicating the interrelationships between atomic elements. Because 
reasonable methods for making such a description are not available, the 
non-professional finds many tasks cannot be described for the computer. 
A more powerful data manipulation and descriptive facility could 
alleviate the problem. , 

Some way of extending a language is needed since anticipation of 
all demands will not be possible, and some will be so specialized 



-368- 



that they should not take resources for development and maintenance 
of the basic processor used b: all* Various means are available: 
single- or multiple-line definitions of subroutines; macros with 
parameters; linkage to other processors; and definition of new 
operators or statement types* Extensible languages are much 
discussed but little understood, and it appears that experimental 
languages may be extended only by the system programmers because of 
the many intricacies in such systems* An easily modifiable language 
might be achieved more by careful attention to the organization of 
the implementation of the language* 

The impljBmentation of all these features in a single language 
which can realistically be used in computer-based learning 
environments will require different techniques for language organization 
and implementation* New techniques will also have to be applied, 
especially in data manipulation and description* 

Summary of General Considerations for Innovative Developments 

The major consideration at this stage in development of 
facilities and procedures must be flexibility* Fot example, 
implementation of one or more processors and their linking mechanisms 
within a general-p^ pose system will enable a systems group to explore 
new ideas in the a environment with initial users, and then 
incorporate those which show promise in the preliminary uses and 
develop them further as use justifies* 

The underlying assumption-~to be recognized is that different 
users and uses have different needs* Is the user learning to program, 
computing a statistic, processing a text, running a simulation, 
building a model, drafting a learning exercise, etc*? In an 
operational setting, a sub-system, language subset, or applications 
package may be tuned to the needs of specific users; student, 
instructor and lesson designer each require a different kind of 
support from the system and a different style of training and 
interaction with the system* 

Interactive mode considerations are especially important for 
the infrequent users* Four statements are made as working hypotheses 
to be demonstrated by studies at the University of Michigan. 

1* An immediate and responsive reply from the system will 
encourage efficient and effective use of the computer as a learning tool. 
Whenever the student-user doesn't know where he is in the system 
or learning exercise and cannot determine what to do next he should 
be able to get a useful reply by questioning the system, and he 
should be able to determine a suitable place to resume the exercise. 
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2. Rules and conventions should be easy to learn and later 
recall when working at the rapid pace of conversational interaction. 
The features of simplicity and interal consistency which are 
important in a batch-oriented system for student uses become especially 
powerful when the user works in interactive mode, trying, testing 

and constructing without reference to manuals, or other assistance. 

3. A comfortable dialogue is possible in which the computer 
processor neither dominates nor leaves the user "in the dark." 

The system should be engineered so that the user can do for himself 
those things he does better than the machine, and the machine can 
serve the user in its area of strength. Machines attend to detail, 
work repetitious tasks rapidly and without error or complaint, access 
large stores of information without memory failure, etc. People ' 
attend to larger structures and patterns, set direction for promising 
investigation, and determine values. 

4. Flexibility during a working session will encourage a user 
to test out an idea, compare different versions of a subroutine, save 
procedures for future, use, and select the most economical as well as 
the most convenient of alternates. The learner-user should feel 
encouraged to test tentative ideas and try out possibilities ^ knowing 
the system will not only permit such explorations, but will help 
them to be successful. A suitable language processor will keep track 
of loose ends while the user is sketching in ideas, accept details 
later on, and provide immediate and interpretable reply when the user's 
instructions are ambiguous or incomplete. 

Although the problems presented here appear to reside in the 
inadequacies of the computer and information processing systems, 
for the most part they will not be solved by development of new computer 
software and hardware alone. Solutions will be achieved only after ^ 
scholars and educators examine current methods of teaching and 
research in each discip'ine and make adaptations for the new age 
of informatics. Developuients in operating systems and language which 
facilitate a problem orientation of software will encourage the 
expert but not solve his problems for him. Total reevaluation of the 
instructional process and the desired objectives for technicians and 
scholars are in order if the computer and information processing are 
to find a suitable place in the educational and professional 
environment. 



A List of Languages, Including Sources for Current Information 

ACME: Advanced Computer for Medical Research. Real-Time Computation 
Facility, Stanford University Medical School, Stanford, California 
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ALCOM: Applied Logic Computing. Applied Logic Corporation, One 
Palmer Square, Princeton, New Jersey, 08540. 

APL: A Programming Language. IBM Scientific Center, 3401 Market 
Street, Philadelphia, Pennsylvania, 19104. Conmiercially available. 

BASIC: Beginner's All-purpose Symbolic Instruction Code. Computer 
Center, Dartmouth College, Hanover, New Hampshire, 03755. Commerciallv 
available. ' 

BRUIN: Brown University Interactive Language. Brown University, 
Computing Center, Princeton, New Jersey, 08540. 

CAL: Conversational Algebraic Language. Computer Center, University 
of California, Berkeley, California, 94720. Comercially available. 

CITRAN and REL: CIT Translator; and Readily Extensible Language. 
Computing Center, California Institute of Technology. Pasadena. 
California, 91109. 

FOCAL: Formulating On-Line Calculations in Algebraic Language. 
Digital Equipment Corporation, Maynard, Massachusetts, 01754. 

IITRAN and CALCTRAN: IIT Translator; and Calculating Translator. 
Computation Center, Illinois Institute of Technology. Chicago. 
Illinois, 60616. 

ISIS: Irvine Symbolic Interpretive System. Computer Facility, 
University of California, Irvine, California, 92664. 

JOSS: JOHNNIAC Open-Shop System. Computer Sciences Department, RAND 
Corporation, 1700 Main Street, Santa Monica, California, 90406. 

LCC: Language for Conversational Computing. Computation Center, 
University of Pittsburgh, Pittsburgh, Pennsylvania, 15213. 

LOGO. Department of Educational Technology, Bolt Beranek and Newmen, 
50 Mbulton Street, Cambridge, Massachusetts, 02138. 

PIL: Pittsburgh Interpretive Language. Computing Center, University 
of Pittsburgh, Pittsburgh, Pennsylvania, 15213. 

POP-2. Department of Machine Intelligence, University of Edinburgh. 
Scotland, " 

QUIKTRAN: "Quick" FORTRAN. Information Marketing Publications, 
International Business Machines, Montereyand Cottle Roads, San Jose, 
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California, 95113. * 

RUSH: Remote User Shared Hardware. Allan-Babcock Computing. Los 
Angfcles, California, 90067. 

TELCOMP,- STRCOMP and ISRCOMP. Bolt Beranek and Newman, 50 Moulcon 
Street, Cambridge, Massachusetts, 02138. 

TINT. System Development Corpora>ion, Santa Monica, California. 90406. 
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COMPUTER-AIDED DESIGN INSTRUCTION SESSION 12A 

A COMBINATION OF DO-IT-YOURSELF PROGRAMMING AND COMPUTER PACKAGE USE ^OOM/SALLE 1A3 

By/Par: W* Bitterlich, D, Procos 

Nova Scotia Technical College 

This describes a course aimed at strengthening those aspects of the design 
process which are frequently bypassed by most architectural students in their school 
design work; usable problem analysis, alternative design development and design evaluation. 

This objective is achieved mainly by introducing the students to a number of 
computer programming packages which can be applied by them directly to the current design 
problems, with a minimum of programming knowledge* At the same time the student will 
be taught rudimentary programming in the Fortran language to insure greater comprehension 
of the above programs and, especially, to give interested students the tools to revise 
them and to develop new ones. Programming instruction is intended to avoid programming 
exercises that do not have direct relevance to architectural problems and will instead 
use simple architectural problems leading to short (10-30 statement) computer programs. 

The course is being given for the first time at the Nova Scotia Technical 
College to a group of Architectural students by the authors of this paper, one of whom 
is an Applied Mathematician who will deal with programming instruction, while the other, 
an Architect, will formulate software relevant to design problems. Positive reinforce- 
ment techniques will be applied to course grading in that higher grades will depend on 
the willingness of the students to make use of the packages as well as on the quality 
of their own programming performance. 

Initial design studio feedback on the success of the course will be 
available when the paper is delivered at the symposium. ^ 

. U FORMATION DES ARCHITECTES Xa'AIDE DE L'ORDINATEUR 

L'ELEVE-ARCHITHCTE FAIT SES PROGRAMMES OU EN CHOISIT PARMI CEUX 6TABLIS 

A SON INTENTION " 

Dans cette communication, nous decrivons un cours dont le but est de 
renforcer ces aspects de la conception qui s6nt souvent delaisses par la plupart des 
el^ves-architectes dans leurs etudes: 1' analyse des probl^mes utilisable, les differen- 
tes solutions possibles et leur evaluation. 

On atteint ce but priucipalement en presentant 5 I'el^ve un certain nombre 
de programmes tout f^its dont il peut se servir en ayant des connaissances minimales 
de pvogramjnation. En meme temps, on apprendra a I'etudiant les elements de base du 
langage Fortran pour qu'il ait une meilleure comprehension de ces programmes et, surtout, 
pour lui fournir des outils lui permettant de modifier et de developper d'autres 
programmes. L'instruction vise S eviter les exercices de programmation n^ayant pas 
un rapport direct avec les probl^mes d» architecture et S presenter des probl^mes 
architecturaux conduisant \ de courts proRrammes de 10 ^ 30 enonces. 

Ce cours est donne pour la premiere fois au College technique de la Nouvelle- 
Ecosse a un groupe d'el^ves-architectes par les auteurs de cette communication, dont 
1 est specialiste des mathematiques appliquees et qui enseignera la programmation. 
tandis que 1 autre, qui est architecte, s'occupcra do la programmation se rnpportant 
aux problSmes de la conception. Une technique de ronforcemcnt s'appliqucra ^ In 
classification de cours, de sorte que les cloves attcindront les nlvcaux plus cloves 
en fonction de I'effort qu'ils feront pour utiliscr les programmes et de la quailtc dc 
leur propre rendement. 

Les premiers resultats sur le succ^s de ce projct scront disponibles au 
moment de la Conference. 
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V,<» kept saying to the computer people yes it's fine for production 
dra>vings or for estimating once you have the basic design established, 
but how do you get to the point? They said to tell them how we design 
and they'd work something out. We +old them something different every 
day depending on what we were doing that day. It was a case of the 

wh^^^r^hfio;!!"^ ^'"?!]'!^''^ ""^^^ analysts could do. We had to show them 
what architects could do." 



J. R. Myer and R. I. Krauss 
Center for Building Research 
Mass. Inst, of Technology 

One of the main problems in using the computer for the teaching of 

rationalized" design processes is getting around the danger of losing 
the student in the process of teaching him the rudiments of computer 
usage. There are a number of danger points: (1) the examples commonly 
used in programming instruction (say the teaching of the Fortran 
language) are often irrelevant to architecture. They tend to turn-off 
all but the most patient students. (2) The architectural problems which 
the student is supposed to solve with his newly acquired resources 
necessarily have to be kept simple. The student argues rightly that he 
already operates at a much more sophisticated level or that he can do a 
much better job of tackling these problems manually. (3) Proqrammina 
and computer expertise in general is cumulative. It becomes must useful 

J^"" learning process when it is perhaps least needed, since 
present computer applications seem to be most useful in the analytic 
stage of the design process (the evaluative stage which does occur at the 
JlLV Pr°9'"f would also lend itself to computer treatment but 

after all evaluation is heavily dependent on the initial analysis). 
(4) Programs that are available to the student in ihe .'after parts of a 
design projec, when he has the expertise to work with them often depend 
on the input of data which are beyond the student's data collection 
capabi I ities. 

One solution to the problem would be to cut o-jt -.•c-r.-n-tni n- f-on the 
architect's repertoire and to rely exclusivelv or. packaoed'^prcnroms. '^u1 
close observation proves this not to really bo a solution: as the quot- 
at the beginn ng of this paper implies, an aroni-.ect should have at lec=: 
a grasp of what a computer can do for him and v.h?t is beyond its scope in 
the present or near future. He should have sorr-o understanding of how the 
computer approach to problems differs from tradlTional design nietnods and. 
in case he wants to make use of these new possibilities, h<n has to com- 
municate with .systems people. This cooperalion will be ear.ier if 1ho 
architect can express to the analyst what he wantc done. Both have 1o 
meet somewhere in between. 
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A more realistic solution then would be to introduce a broad ranqe of 

SlShrfVr'^ f" ''"^ "^'^^"9 ^"^^ ^^--^ s not being 

Iri^^^!. ^^'^''Ji^!^^"'"^' applications but rather that design techniaues 
are be ng taught through the medium of Fortran. Essentia I J what we are 

We chose a three-pronged attack on the problem: 

(a) The use of as architectural a vehicle as possible for teachinn nm 
?;n^t;^»?^e^co:^::? ^"-^^'-^ - stSdenttrfn^ ZlXl 

iacklSes^Jlrlhf '■""^i'y reasonably useful computer 

SseSlness of ?^ students, in order to "sell them" on the 

usefulness of the computer in their everyday work. 

(c) The introduction of incentives for the students to use comouterizpd 
processes in lieu of the usual intuitive ones. computerized 

These three components took the followjng detailed form: 

inVoHrir! ^'e'^^+s of Fortran were introduced, mathematics (as used 
areas wore tZ^Tn^^^'V^ P^^^^^"^' Instead uch 

of tnterest ^nH . J ' T^^'^ °" ^^"^^ which might be 

riei lui nnHp" + '? P'"°^^"- Tl^l^ was J"+ended to be car- 

nea out under two main topics: 

t •) Simulation 

Simulation can be introduced on a very basic level bv st^^rtinn ,,i+h 

SI'cr!;'' 1""°::"^ 'J'' aps' ate ' 

simple critical path networks with random job completion times ranHom 
search and queueing models can bo introdocid. '^^ndom 

Parallel to that 1he student becomes .fami i iar with the main elements of 
programming such as looping, branc'fif ngTdesign ing of flow charts Ihe 

m't^on'ori^ "'-sT'"'^" °' non-tri Jal mathematics s ch as tJansfIr! 
m t.on of distributions ore not to be taught but rather to be aiven as 
subprograns ,n the same way fhat an engineer does not actualty^ ea?n how 
to program the square root function. The stress must be on des gn^nq the 
Zll lotZV:. ^^^-^'"^^^^^ an. stochastic rel at?:ns??;s^b:'^ 

Thus programming becomes similar or complementary to architectural design. 
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(M) Use of Matrices 



There Is no reason for the student to learn how to multiply or in- 
vert matrices etc. Matrices should rather be used to describe' e a mane; 
relationship tabulations, and (mainly two-dimensional) space. "op;?;t?oSs' 
with matrices are restricted to multiplication by constants and addition. 
This IS necessary and sufficient for combining parameters describing dlf- 

ll?r.V f^!?!' '^"^ +yP^s °^ drainage. This type of 

matrix handling is extensively applied in some computer packages 
especially In space allocation programming. 

(b) We saw how the sequence of programming can be gradually unravelled 
through the parallel development of simple simulation and matrix mani- 
pulation techniques. At the same time the student has to be given an 
early opportunity to make use of the new tool whose usefulness and 
potential he Is barely beginning to perceive. This is done through 
computer packages made available to the student with explicit directions 

I !^'" ' "dilation of their internal working and a clear 

Idea of the kind of output that can be expected from them. 

It should be pointed out that the packages themselves are not new. We 
used existing ones or wrote new ones based on somebody else's theory. 
This was not because we felt that existing software filled all architects' 
needs and could not be perfected. We simply felt that the greatest gap 
between program fo-mulation and program use in computer aided design was 
due not so much to technical imperfections as to limited or superficial 
. use of these programs by the users that they were planned for. This Is 
why we decided to_ concentrate on the application of these programs in 
the students' design context. In fact we decided 1o try to intororol 
future successes or failures in the application cf computer pacKaaos n-ore 
in terms of the usefulness of a particular pockc^.e to a particola'r 
* !! • V®®^^ ^ Pa'~*''cular stage in his or her dssign Than in Icnns 
?K workings of the program. In short, we tried 1o .>ppro.K-h 

the intuitive design process which is still tno c.rciiitocturol siuder.i'^; 
major tool with a great amount of respect and circumspection. Specif ical Iv 
we chose the following programs: ^ 

1. For site selection In terms of distance requirements of the facilitv 
being dos.gned for from certain giv3n fixed poinTs, .ve developed SFATLOC 
a program derived from a paper entitled "Graphical Represen i ai icn cf 
Matrix with Applications in Space Allocation" by C.E.S. Lindgren and ' 

C. bteinitz of the Centre for Environmental Studies "at Harvard University. 

2. For site selection In terms of optimising a number of si1o chara'-^cr- 

1 sties, we used CASAT, a program developed in PL I partly on the ba<-.i^ cf a 
lechniquo developed by Ian McHarg. This program prcson-fs 1ho desiq.-vr at 
various stages with alternatives to choose from. It gives 1hc student the 
opportunity to fill "gaps' by formulating and programming more or less ^ 
sophisticated selection criteria. 
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3. For the Internal workings of a building In terms' of arrivals and move- 
ments of users and material we have QUEUE, a program that simulates arrival 
and queuing. 

4* For relating various spaces to each other In diagrammatic form we chose 
CLUMP, a program developed by W. J* Mitchell of U.C.L.A. 

5. For a number of alternative attempts at Inter-relo+tng various spaces 
In actual physical plan form weusedLOCAT, a program ti^at prints out plan 
configurations without the use of a plotter. 

It is seen that the programs described are developed along a certain 
sequence of operations which approximates the operations that a student 
goes through when tackling a design project Intuitively. Firstly, site 
selection takes place on a basis of optimization of requirements and 
cumulative site characteristics. Secondly, a simulation is attempted of 
the kind of dynamic processes that will be happening when the facility Is 
being used. Thirdly, the conceptual relationship of the various static 
spaces in the facility Is deteimlned and fourthly, a tentative physical 
design is generated. 

(c) In trying to ensure that the students use the computer packages avail- 
able to them, we soon realized that it would be unrealistic to use 
negative rel^nforcement techniques, I e, to tie a pass mark for the course 
(a mark of C) to the compulsory use of these packages. !t would be too 
easy for the students to claim that their failure to use a certain package 
was due to flaws Inherent in the package which they had been able to 
detect from the outset without having to run the actual program. 

As a result we decided to switch to positive reinforcement, ie, to tic the 
use of computer packages to a system of rewards (in this case, riiarks above 
tha passing C level) that v/ould give a strong i^^c^ntivc for the stud3'^t 1o 
try his hand a1 t:ieir use. It should be s^rci>s. d again tnat wc are not 
necessarily after successful appi icationr, thni v jm der^nstn-b I y improvo tk.c 
Intuitive design procoos; failures by the sf.' Ir-rr; in apolyinr^ oro'vr^jrr. lo 
his own design project would also be reworood if ,....7 luid cloorly pin- 
pointed the deficiency and if the studcnl couio ^.^^^h;Ml|y cxpldin ihii^ 
deficiency. In fact a studcnl could concoivonlv '-Xijivo u furirujr nor;, 
bonus for suggesting realistic additions or cU^:\..,^ 10 tho puckjjj ll;..: 
would show thai' he or she has undcrr.tccd Mio -jl , oven if lho rrjjpli- 
cation of the revised program to his or hnr ov;n do^irin is again incon- 
clusive. The actual marking system we devised v/ouki give a mt:)rk of A for 
two such attempts, in both cases regardless of 1hc elegance or results of 
the attempt as long as there was an effort there. 

At the bottom end of the marking scale we had to devise a way to determine 
the pass - fail component (the C mark). The procoduro we decided to follow 
consisted of providing the students with a list of very simple problems that 
could be solved by short (10 to 30 word statement) programs, which would 
be within the progromming capabilities The siuur.r /.ould havo a^.ciui'oJ jfound 
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The middle of the course. Each student would have to write and successfully 
run two of these programs to reach a C mark. Alternatively the student 
could write his or her own problem and the corresponding program, based on 
current or projected needs within the design project. In which case one 
program would be enough for a pass mark. 

Initial Feedback and Conclusions 

In many ways student response to our course has worked out In the way we 
anticipated: a good number of students made use of the packaged programs 
quite early In the course so that, at the writing of this assessment ( a 
little after the mid-tenn) about 50Jl of the students have had first-hand 
experience of a computer responding to their data and to their analysis 
of a design problem. Work on the programming component has been somewhat 
slower In coming but we are going on the resumption that a student who 
has already "reserved" a B or A grade will have a higher than usual moti- 
vation to do the pass-fall work necessary to confirm his higher standing. 

Whether or not future developments bear out this assumption Is of more 
than limited Interest to us. A successful outcome will of course confirm 
the usefulness of teaching a body of knowledge against which there Is 
often considerable resistance among architects and students, but It will 
also reflect favorably on the particular Instructional methodology we 
used: that of separating work aimed at demonstrating student excellence 
from work aimed at showing mere student competence and of using the at- 
traction of the first to overcome student resistance against the second. 
We feel that this approach Is appJicable to a wide variety of Instructional 
situations. Wo also feel that computers, through their ability to "pre- 
package" much of the background material necessary for advanced learning 
experiences will be tnstruinental In bringing about its application. 
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THE USE OF GROUPS IN COMPUTER-ASSISTED INSTRUCTION SESSION 12B 

„ /„ ^, r. o . u ROOM/SALLE 1A3 

By /Par: Glenn F. Cartwright, 

University of Alberta. 

Universite de I'Alberta. 

A central principle of computer-assisted instruction (CAI) is that students 
are taught individually. Seldom has the teaching of groups of students bv computer 
been considered. In this study, 282 McGill University students, beginning a summer 
course in educational psychology, were selected from a group of 320 for their relatively 
minimal knowledge of general psychology. Subjects were randomly assigned to one of 
four treatments: a control group worked with CAI individually, and three experimental 
Sroups worked with CAI in pairs, or in groups of three or four. Three CAI lessons in 
general psychology ware presented, each a week apart, by the McGill IBM 370/155 computer 
on eight teletype terminals. Students working alone responded individually: students ■ 
working m pairs or in groups discussed the lesson material, decided on a single 
response, and typed it in. During the fourth week, each student responded individually 
to a thirty item multiple-choice test based on -the three CAI lessons. Analysis of 
variance procedures indicated that there were no significant differences in means 
amorj: the four treatments. This suggests that students learn equallv well from 

I-""^*?'' i"f:'i''"«"y in 8»^0"PS. Not only does group work at CAI terminals 
provide a dimension of human interaction not possible with individual CAI, but operating 
^r,^„H!l""T% possible, depending on the group size. Further research 

Is underway to determine the effect of social, at^itudinal. and personality variables 
on learning with CAI in a group setting. r j- 

L'UTILISATION DE GROUPES DANS L'ENSEICNEMFaNT A L'AIDE D'ORDINATEURS 

„ principe important de I'lnstruction a I'aide d'ordinateurs (CAI= 

ind^^Hf-nr^^?"" instruction-) reside dans le fait que les eUves ont un enseignemer 
mdividuol 11 est rare que I'on ait pense 3 er.ieigner a I'aide d'ordinateurs a des 
cZe^r;™„ r^""'' ""^f • Studiants de I'Universite McRill furent choisis, au 
commencement d un cours d'ete en psychologie pedagogique, dans un groupe de 320 pour 
leurs connaissances relativement minimales de la psychologie generale. Des sujets 

travanJ -^^^ / ^f"'""^"' ^ ^'""'^ '^^ 'J"^- - ""^thodes: un groupe de contrSle a 
ItZililt ^"''^^J^^ell'^n-ent avec la CAI et dans les trois groupes cxperimentaux les 
etudiants travaillaient en sous-groupes de deux, trois ou quatre. Se servant de 
Wntrrin "'"'k ""370/155 a huit terminaux 3 teletypes, on a presenTtrols 
lemons CAI de psychologie generale, a une semaine d'intervalle. Les etudiants 
travaillant seuls repondai»nt Individueller-ent , ceux travaillant en groupe discutalent 
entre eux avant de decider de la reponse et de I'entrer dans I'ordinateur. Pendant 
la quatriSme semaine, chaque etudiant repondait individuellement S un test a choix 
multiples de trente questions base sur les trois leqons CAI. L'examen des resultats 
a montrc qu il n existe pas de differences importantes entre les quatre mcthodes ce 
^n^^T^■'"^^"^f ^^^^^ ''"^ etudiants apprennent aussi bien en CAI, que 1' instruction 
solt Individuelle.o., en groupes. Le travail en groupe prcsente non seulement I'avantage 
de relations humames mais permet aussl de reduire le cout du fonctionnement'jusqu'a 

1 inT>ortance du groupe. Actuellement, nous poursuivons les recherches pour 
des I^udi^ni variables sociales, de I'etat d'esprit et de la personalite 

ces etudiants travaillant en groupe. ' 
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ABSTRACT 



The study traces some of the historical antecedents of computer- 
assisted instruction and considers the group facilitation of individual 
learning using CAI. During a summer course, 282 educational psychology 
students, screened for their lack of background in general psychology 
were randomly assigned to one of fear treatments. A control group 
worked with CAI individually, and three experimental groups worked with 
CAI in pairs, or in groups of three or four. Three CAI lessons in 
general psychology were presented. During the fourth session, each 
sM-.dent responded individually to. a thirty item multiple-choice test 
b.-sed on the lessons. No significant differences, in mean learning 
scores for individuals were found among the four groups suggesting that 
students learn equally well from CAI whether taught individually or in 
groups. The study has implications for those who would reduce the over- 
all cost of CAI by up to 75% and at the same time lessen the threat of 
dehumanization posed by the technology. Furtljer research is underway to 
determine the effect of certain personality, social, and attitudinal 
variables on learning in groups with CAI. 



Introduction 

T le development of computer-assisted instruction (CAI) has tradi- 
tionally rested heavily upon the advances made in programmed instruction 
(PI) and teaching machines. Indeed the first reported attempt at CAI 
(Rath, Ande„-son, and Brainerd, 2959) was described as an attempt to 
mimic the teaching machine using a digital computer. 

One of the most significant claims made in the early days of the 
teaching machines, was that they provided individual instruction. In 
truth, a single machine could do little else, and little else was 
expected of it. The technology had not arrived at the point where a 
single aachine could be used successfully to replace the teacher in 
instructing a large class. In fact, to allay the teachers' suspicions 
that they might one day fall victim to automation, the claim was made 
that far from replacing teachers in the classrooms of the nation, teach- 
ing machines would "free" the teacher for other more creative tasks. 
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Just what these "creative" tasks were, was never usually specified, and 
whether or not teachers using PI have in fact been freed from class- 
room drudgery remains to be verified. Nevertheless, the potential for 

freeing the teacher helped foster an attitude of acceptance towards 
mechanized teaching, at least among some members of the teaching profes- 
sion and an even larger segment of the public. 

Since those who espoused the cause of PI and teaching machines 
valued the one-to-one tutorial method of instruction above all else, the 
fact that the teaching machine would teach only one person at a time was 
viewed as an asset rather than a liability. Here was the teaching 
machine s strength. Produced in large quantities, it could claim at 
least individual" if not "individualized" instruction. 

The development of computer time-sharing systems enabled CAI to 
follow along the well-beaten path of "individual" instruction, by provid- 
ing now, not one machine, but one computer terminal per student. How- 
ever, the proliferation of computer terminals, like the mass production 
of teaching machines, seems to have contributed only to the expansion of 

individual" instruction. The exciting potential of "individualized" 
instruction remains yet to be realized. 

It was not long however, before those in PI realized that an 
optimally perfected program might be able to instruct more than one 
student simultaneously. Several attempts have been reported (Frye, 1963- 
Farber, 1965; Hartley, 1966; Sawiris, 1966; Hartley and Cook, 1967; 
Moore, 1967; Hartley, 1968; Kay, Dodd and Sime, 1968; Frandsen, 1969; 
Amaria, Biran and Leith, 1969; Amaria and Leith, 1969; Hartley and 
Hogarth, 1971). The results of these experiments seem to indicate that 
individuals in pairs or groups using PI attain at least as much as do 
individuals working alone with PI. The learning of individuals in 
groups does not seem to be impaired as a result of the group experience. 

These same findings hold for the few studies which have been done 
with pairs of students in CAI (Grubb, 1965; Goodman, 1968; Love, 1969). 

With the present .high costs of CAI , tremendous savings might be 
effected if it were found that CAI could teach groups of students as 
well as it could teach individuals working alone. 

Two arguments stand in the way of implementation of group CAI 
study. The first is the belief that group instruction removes the 
advantage of individual pacing, long believed to be a necessary feature 
of individual instruction. There is mounting evidence however, that 
individual pacing often is not as effective as group pacing. A student's 
own pace is not necessarily his best pace; often students who choose 
a fast pace makemore errors, while those who choose a slower rate 
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frequently become discouraged with their slow progress (Cropper and 
Kress, 1965; Moore, 1967). It may very well be that under group-paced 
conditions many students would excell. 

The second obstacle is the lack of distinction and therefore 
confusion, between the terms "individual" and "individualized" instruc- 
tion. It is suggested here that the two are not the same. Having an 
individual working alone at a terminal does not guarantee that his needs 
have been met. Neither does meeting those needs require that he work 
alone. Truly "ii^dividualized" instruction, where the program is geared 
to the intellectual, social, and personality characteristics of the 
learner, may just as well take place in a judiciously organized group as 
in the solitary confinement of a carrel. 

The present study was concerned with ascertaining whether or not 
CAI could teach individuals in groups as effectively as it could teach 
individuals working alone. 



Subjects 

Subjects in the study were 282 summer school education students 
at McGill University. The students were screened from a larger group 
of 320 students, and were chosen for their lack of background knowledge 
in psychology. Most of the students held at least a bachelor's degree, 
and were proceeding to teacher certification through three consecutive 
summers of a teacher education program. All were in their first summer 
(1971) of the three year cycle. They ranged in age from 20 to 59 years 
with the average age being in the late twenties. 



Procedure 



Each of the 282 students was randomly assigned to oroups of 
varying sizes. Some worked alone, others in pairs, still^others in 
groups of three or four. Each group took three CAI lessons in basic 
psychology, each one week apart. The three lessons wera based on chapter 
four and five of Hebb (1966) and were originally desig ed for use in 
other studies (Roid, 1971). Each of the lessons consisted of about 35 
frames , requiring the student to respond by typing in a word or phrase. 
Provisions made for branching to remedial sequences. Together the three 
lessons formed an integrated unit of work based on the nervous system, 
sensory control., motivation and arousal. 

Students worked in their assigned groups, read and discussed the 
material as it was displayed, and voted on a single answer. One person 
from each group was designated to respond on the teletype by typing in 
the group answer. 
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The lessons were coded in MULE (McGill University Language of 
Education) and were presented by the McGill 370/155 RAX tiine--sharing 
system on eight teletype terminals. 

One week after the final lesson, each student individually 
completed a thirty item multiple-choice test based on the three lessons. 

Results 

Means and standard deviations of learning scores for the four 
treatments were found in TABLE 1 below, 

TABLE 1 



INDIVIDUAL LEARNING SCORE MEANS AND STANDARD DEVIATIONS 
FOR THE FOUR TREATMENT GROUPS 



Treatment Group 


N 


Mean 


s.d. 


Variance 


1. individuals 


78 


16.22 


4.49 


20.15 


2. pairs 


61 


15.89 


3.83 


14.64 


3. groups of three 


80 


16.04 


3.81 


14.52 


4. groups of four 


63 


15.92 


4.27 


18.27 


Total 


282 


16.03 


4.09 


16.72 



The uneven numbers in some of the treatments in TABLE 1 are due 
to several people working in groups during the three lessons but not 
completing the criterion test due to absence. Results for their partners 
are included since the groups were intact during the lesson phase of the 
project, 

A simple one-way analysis of variance procedure was used to 
compare the mean learning scores of the four treatment groups* The 
results are found in TABLE 2 below. 
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TABLE 2 

ANALYSIS OF VARIANCE JIESULTS FOR THE FOUR TREATMENT GROUPS 

-'-ON LEARNING 

. • Sum of Mean 
Source df - Squares Square F p 

^''°"PS 3 4.813 1.60 0.09 0.96 n.s. 

Error 278 4709.000 16.94 

— - — 

Homogenity of Variance test: Chi square = 2.90; p = 0.41 N = 282 



Discussion '^^'1, 

• 

It would appear from the non-significant mean differences among 
treatments that individuals learn equally well from CAI whether they 
work alone, in pairs, or in groups of three or four. 

Often, studies comparing CA; ,with other instructional modes 
find no mean differences between methods, but a significant increase in 
the variance of learning scores for CAI. This is usually attributed 
to the fact that CAI is more highly individualized than other teaching 
methods, and the extent 9f individualization is reflected in the 
variance of the scores. Comparing the variances for individual and group 
CAIIaethods, the results in TABLE 2 indicate no significant differences. 
One interpretation might be that the learning of individuals in groups 
was Just as higMy individualized as the learning of those who worked 
alone. Other factors such as heterogeneity of the group may well 
influence learning score variances, but group size per se appears to 
have little effect. 

Since neither group means nor variances differed significantly 
among treatments, it is suggested that the group use of CAI may be 
implemented as a legitimate (and less expensive) alternative to 
individual CAI, without affijcting learning performance. 

With respect to pacing, it may be argued that students who worked 
alone were individually paced, and those who worked with others were 
group paced. The lack of significant differences in mean learning 
scores between individually paced and group paced students tends to 
lend support to the claim that individual pacing is not a vital or even 
necessary feature of CAI. 
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u ^ . r ^^^"^nistic viewpoint, the group use of the computer may 
help to make CAI more acceptable to those who see the technology of 
individual learning as dehumanizing. Elsewhere it has been suggested 
that the computer can act as a catalyst for social interaction 
(Cartwright 1971). This removes from CAI the responsibility of provid- 
ing all the interaction necessary for human learning. From the 
learner's point of view, having others present at the terminal may prove 
to be less frustrating in the case of terminal malfunction or difficulty 
or operation. ^ 

Assuming the same execution costs for groups as for individuals 
cost savings of up to 75% may be realized with four people per terminal. 
With the group method, the cost of a single lesson is divided among 
four students. Slight variations may occur here however, since it is 
not known if groups take more time exploring the various branches in a 
lesson, or increase terminal connection time by overly long discussion 
of the material. Further research is underway at the moment to determine 
if the average execution time is longer for groups than for individuals. 
It should ?lso be pointed out that the optimum group size around a termi- 
nal IS not necessarily four and that larger groups may be possible, 
reducing costs ever further. 

Further research is underway; to determine if students with par- 
ticular personality, social, or attitudinal characteristics benefit 
more from the group CAI than the individual CAI approach. In this way 
It may be possible to optimize learning performance by assigning 
students to the most beneficial CAI instructional method. 
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SESSION 13A 
ROOM/SALLE 148 



Several computer-based vocational and educational counselling systems 
have been developed which are intended to undertake some of the functions ordinarily 
performed by a human counsellor. The purpose is to provide the counsellor with a 
tool, and to offer the student a more readily available service. 

Almost invariably, however, such systems have used a large time-shared 
computer. It was therefore considered appropriate to develop a vocational 
counselling system on a small time-shared machine such as a large school or small 
school board could afford to rent or purchase, A machine of this type could, of 
couise, be used for a variety of other purposes simultaneously with the operation 
of a counselling system, — 

A vocational counselling system was implemented on one of the smallest 
time-shared computers at present available. Designed in accordance with current 
counselling procedures, the system is in no sense prescriptive. It assists a 
student in defining his interests and aspirations, and helps him to explore a 
variety of occupational choices. It offers some of the guidance ordinarily given 
by the counsellor, rnd may be followed up by the use of more detailed printed 
materials to Wiich the student is referred. 

Preliminary tests of the system were considered successful, and more 
extensive experiments are In preparation, 

L'ORIENTATION PROFESSIONNELLE X L'AIDE DE HINI-ORDINATEURS 

Plusieurs syst^mes poar conseillcr en mati^re d'education et d'orienta tion 
professionnelle en se servant d 'ordinateurs , ont ete de^loppes en vue d'assuJeJ^ 
certaines fonctions qui sont habituellement celles des conseillers humains, 
L ob3ectif est de *ournir nn outil au conseiller humain et d'offrir B I'etudiant 
un service plus accessible, 

Cependant, Je n^ls systSmes ont presque toujours utilise un grand 
ordinateur a temps partage, 0« a, done, pense qu'il conviendrait de developner 
un systSme d'or -entation professionnelle h I'aide d'une petite machine S temps 
partage de sorte qu une grande ecole ou un petit conseil scolaire puicse la 
louer ou 1 acheter, Une machine de ce type pourrait, naturellement, servir ^ 
d autres usages simultanement avec la mise en oeuvre d'un systeme d 'orientation. 

On a etabli un systeme d'orientation professionnelle base sur I'un 
des plus petits ordinateurs I temps partage disponibles actuellemcnt, Concu 
en conformite avec les methpdes actuelles de conseil, Ic systeme n'est rullement 
rigide ou imperatif, II aide I'etudiant. ^ determiner ses interets et ses 
aspirations et il Vaide I choisir parmi de nombreuses occupations ou professions, 
II donne cerlains conseils normalement fournis par le conseiller humain et il 
peuc completer ses conseils par des renseignements imprimes 'plus detailles qui 
sont a la disposition de I'etudlant, 

Des essais preliminaires ont reussi et des experiences plus etendues 
sont en cours de preparation < 
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There is general agreement among counsellors that the amount of 
information they need to have at their command is increasing at such 
a rate that it may soon be overwhelming. Further, the amount of 
time a counsellor has to spend in dispensing such information to 
students is such that it is impossible for him to do it adequately, 
and also continue to perform the more characteristically human 
functions of a counsellor. If we also consider the shortage of 
competent professionals in the field, it becomes obvious that there 
is an urgent need to provide counsellors with technological aids so 
tuat they may use their own time more efficiently and more economi- 
cally. 

The assumption underlying this paper is that it is now both 
technically possible and economically feasible to provide the 
counsellor with access to a time-shared mini-computer. He may use 
such a computer as a sophisticated tool, wh.ich simulates some of the 
sinq)ler parts of his own counselling behaviour, as in the case of 
some aspects of vocational and educational counselling. 

A number of computer-based vocational and educational counselling 
systems have been developed in recent years. The first of these was 
produced by Cogswell and his colleagues at System Development 
Corporation (1965) . Others have been described by Loughary (1966) 
Tondow and Betts (1967), Tiedeman (1968), Impellitteri (1968), 
Super (1970), and Romaniuk and Maguire (1970). 

In some cases student information is presented to the computer on 
punched cards, ana the system replies by means of a printed output. 
For the most part, ho'/ever, time-shared systems are used. The terminal 
equipment frequently consists of a teletype device only. Sometimes it 
also includes a slide projector and a tape recorder under computer 
control, and occasionally a cathode ray tube terminal is used. Most 
terminal equipment may be placed at the end of a phone line, and may 
be remote from the computer. 

All the counselling systems referred to above, however, have in common 
the fact that they are implemented on a large computer. In the Computer 
Applications Unit of the Faculty of Education at the University of Calgary 
a vocational counselling system has been developed and implemented on one ' 
of Che sma].lest time-shared computers currently available. It was con- 
sidered nec;essary to develop a counselling system on an inexpensive 
computer because, in many circumstances where such a system is needed, 
there is at present insufficient capital to obtain a large machine. 
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Further comunications costs are too high to allow operational 
use in a school of a terminal attached to a computer which is 
beyond the local phone area. " 

^h«^^„Tl:^"^ ^^^^^'y ^^ed costs no more 

than equipment which is routinely installed in small tfolleges 

Ztt tlll ^^f ''^^ "»P"ter has a central pJ^Jesfing • 
unit with a 1.6 microsecond cycle time, 16,000 words of core 

DK^an/H^^^^'^^^r""'' ^^^^ 25C,000 words, and six 

DECtape drives. It supports a time-shared system for 16 terminals 

Trltrllf'rr'''' '"""^"^^^ on'computer assis^d 

iJoW^^J°" ^""^ * ^i*" and a slide 

projector under computer control. 

Kn^^*' «=he present time the vocational counselling system uses 
Jhf i^^''^ f * projector, and therefore operates at 

the computer assisted instruction desks. It is writtei in SCROLL 
a language developed in the Computer ApplicationrJnit and ' 
requires the use of two tape drives. 

thJlt °^ is « simulation of part of 

n^rf^S f L * vocational counsellor. It is intended to 
perform functions similar to those ordinarily performed by a 
counsellor, and must therefore conform to desirable counselling 
ITITT,^ However the aim is not to replace the couJ^Sior? 
JrHpr Pf°^"^ him with a new tool which he may use in 

ne™i^*rE '^"^ greater effect. It is therefore 

sho^?r„^I:^f ! ^i^P°i"«=' i«= is important that the system 
should provide all that the counsellor would ordinarily provide 

be Sr/jS^?'***^ °^ vocational counselling. It shoJld, however, 
be more readily accessible than the counsellor. This may indeed 

syst^^" °' advantages of a compuJ^r-bLS* 

«ho^^r^" consideration is that any vocational counselling system 

tl^ rt '^^^ " "^'^^^y ^ll*"'^ "Vision of its daL 

base, conditions of employment, wages and salaries, entry require- 

Sf H;.f^:'/'? changing rapidly. Information of this kind forms 
cSn.^!^^^ «. vocational counselling sy.t.m and has to be 

constantly updated. 
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In present counselling practice no attempt is made to direct 
the student into a particular type of vocation, still less into 
a specific occupation. He is encouraged to discover his own 
interests, to set his own educational goals, to explore a number of 
specific occupations. The object is to promote the decision-making 
ability of the student by making information available to him, and 
by giving him opportunity for vicarious experience in the making of 
occupational choices. 

^ The first task in the development of the system was to devise a 
classification of interest areas. The categories had to be defined 
in plain language so that they could be understood by all high 
school student users and, insofar as possible, the definitions had 
to be such as to exclude the possibility of overlapping categories. 
Eleven such categories were used. 

The definition of categories of educational and training aspirations 
presented less difficulty. High school programs ^'re classified as 
matriculation, business, vocational or general. Beyond high school 
level, a student may follow a well defined route in terms of taking an 
apprenticeship or attending a technical institute, a college, or a 
university. Seven aspiration categories were used, ranging from 
"less than high school diploma" to "university". 

It was necessary to have a data base of vocational materials with 
clear local relevance. It was therefore decided to make use of data 
provided by the Car'^er Information Services of the Guidance Department 
of the Calgary School Board. Approximately 209 job titles so obtained 
were classified into the interest categories listed above. Each job 
description was then examined to determine the minimum educational or 
training level required, and on this basis the job title was allocated 
to one of the education and training levels. Lists were then made of 
all job titles within each interest/educational category. In all there 
were 77 interest /educational categories, with a maximum of 51 job 
titles in any one category. Several categories were, of course, empty. 

Data for the development of the student file were derived largely 
from information contained in the student's cumulative folder. Each 
record contained an I.D. number, age, sex, high school program enrolled 
in, courses presently being taken, .^courses taken in the past and marks 
obtained, and total credits obtained to date. Test information such 
^as intelligence scores, interest inventory scores, and aptitude test 
scores were also included. 
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When brought into use, the system immediately informs the student 
th«t he may at any time type QUIT to terminate the session, or 
RETURN to go back to the start. The two modes of operation are then 
explained and he is asked to choose one of them. If he chooses the 
exploration mode" he is presented with a slide showing the list of 
interest categories. He determines his interest arei- and types in 
the appropriate number. A record slide is then presented, showing 
the list of educational and training categories. Again he makes his 
choice by typing in the appropriate number. A third slide is then 
shown, having a list of appropriate job titles. Each such slide is 
preceded by an appropriate code number. Upon typing in the code 
number of a job, he is presented with a brief description of th(- job, 
SjBecial educational qualifications required, length of training, 
employment opportunities, wages, etc. 

* 

The stu-Ient's record is then compared with the job requirements 
- and a series of messages is printed .-t ; he terminal. These tell the 
student whether he is present?/ in the correct "route" in school to 
-Become qualified for this jot, how many credits are required for 
'entry to the job and at what level, how many credits he has already 
acquxred and how many more he will need upon successful completion of 
his present courses, any specific subject requirements for the job, 
and- which of rliese he has already met. No evaluative comments are 
made: the student is merely presented with the facts and is allowed 
to make his own decisions. He is given a reference to the appro- 
priate care-r information booklet published by the Calgary Public 
School Board, and he may use the job code number to obtain further 
information from the school counsellor. 

The system then asks the student whether he wishes to quit, return 
to the same list of job titles, return to the beginning of the 
exploration, or return to choose another mode. 

The "index mode" simply provides, by means of slides, an index to 
all job titles so that they may be accessed directly. It is es- 
pecially helpful to students who wish to obtain information about 
specific occupations. The terminal first presents a summary index, 
from which the user may obrain the alphabetic section of the index 
including the job title fn which he has a special interest. Each job 
title IS preceded by a code number and upon typing in this number the 
student may obtain the job summary. In each case he also receives a 
printout of the comparison between his own record and the job require- 
ments, as already described. At any point he may quit, return to ' 
choose another mode of operatiqn, or' return to the sufoniAry indSx in 
order to choose another alphabatic section. ' ' ^ 
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The counsellor may use the icploration and index modes. He also 
has a third node, in which he obtains direct access to the student 
data file. 

The system has undergone preliminary testing. Thirty six high 
school students were drawn in equal proportions from males and 
females in- Grades 10, 11 and 12. Each used a terminal for four 
sessions of 25 minutes. Using as a criterion the number of jobs 
examined, there was no evidence that use of the system was related 
to either language ability or clerical speed and accuracy. There 
was a significant correlation between intelligence and the number 
of job examined. However, analysis of covariance indicated no 
differences in the amount of use by grade or by sex. There was no 
reason to assume that the system was not equally usable by students 
or both sexes and at each of the three grade levels. 

A Likert-type questionnaire and a brief essay both indicated 
very positive attitudes towards use of the system. Students found 
the teletype easy to use, they wanted more time on the system, and 
they suggested extension of its use to Grade 9. 

The system has been very well received by counsellors. It 
therefore now being modified and prepared for more extensive 
testing. 



is 



In effect, experience to date suggests that further experimentation 
is warranted, and that a useful and economically viable system can be 
developed. ^ 
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Not all aspects of language- teaching can be automated); some facets of 
language-learning seem adequately catered for by conventional programmed instruction 
techniques and automation appears superfluous; many parts of a French course can best 
and most cheaply be mastered with the help of computers. 

The parameters to be considered are the time the student requires to reach 
criterion performances in listening comprehension, memorisation and adaptation of 
conversational formulas, a measure of self-expression using grammatically correct 
constructions and appropriate morphemes,. and reading comprehension at various levels 
of complexity; the efficiency of instruction aimed az helping the student reach the 
goals envisaged; the cost of elements in the system financed by the teaching authority - 
administrative, hardware and software. 

Automation of some aspects of administration (including the teacher as 
administrator in the classroom) leads to computer-managed-instrucuion with certain 
fixed costs being compensated by a number of educational advantages; automation of 
certain skills allows the teacher to concentrate on creative aspects of language 
use in a group situation - and the l9*-k of this element in many teaching contexts 
leads to a high rate of failure in meeting objectives of foreign-language courses. 
Automation alone can provide certain information to improve the efficiency of phonetic 
dif Serene iat ion as element in language teaching. 

LES ASPECTS gCONOMIOUES DE DIFPgREXTES M£rrinD£S DE 
LEKSEIGNEHENT DU FRAXCAIS A L'AIDE D*ORDIN\TEURS 

II n'est pas possible d' adapter I'enseignement 5 ;'aide d'ordinateurs 3 
tous^les aspects de I'enseignement d'une langue; certains semblent se preter d'une 
oaniere satisfsisante ^ des techniques d'enseignement programme convent ionnelU^s et 
l^autonaf.ion parait superflue; I'ordinateur, en ce qui concerne beaucoup d'clements 
d un cours de frangais, s'avSre le moyen le plus efficace et le meilleur marche pour 
1 apprendre. 

Les param^tres dont il faut tenir compte sont: le temps necessaire 
1 etudiant pour atteindre le niveau exige en ecoutant, en comprenant, en apnrenant 
par coeur et en adapL-nt les formules de 'conversation, en pouvant s*expr:mer en 
termes grammaticaux corrects avec les morphemes appropries et .en conorenaat la * ' 

lecture 5 divers niveaux de difficulre; I'efficacite de I'enseignement pour cue 1' etudiant' 
arrive aux buts proposes; le cout des elements du systemc finances oar les autoritcs 
de 1 enseignement, c*est-^-dire I'administration, les ordinateurs et la programmation . 

L'automarion de certains aspects de I'administraf ion (y comptis le professeur 
en tant qu'adninistrateur dans la class^V^^ne 3 I'cpseignement gere oar ordinateur 
oil certaines depenses fixes sont compehsSes par des avantagcs educatifs; I'automntion 
de certaines techniques pernet au professeur de norter toute son attention sur les 
aspects crcatifs dc 1" imploi de la langue dan? un groupe et, dans beaucoup de mi lie 
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Automated French Teaching requires auproDriate 
hardware, a satisfactory programming language and a suitable 
team for the physical production of the pedagogical materials. 
For a scheme to be economically viable, cauital investment 
and recurring maintenance and comm\jnication costs over a real- 
istically short period must be distributed over a large enough 
population to be competitive with cheap non-automated systems. 

The cost of teaching French in any area is intimate- 
ly bound up with the size of the population to b^ reached and 
J^E.f®^^^^^^^®^-'- distribution. There are areas where students 
of French are so few in certain levels of competence that 
conventional teaching can become uneconon^ic . It solves nothing 
to regroup arbitrarily learners in the same field regardless* 
of disparity of background and achievement. Individualized 
methods of instruction may free a teacher so that he can deal 
with his students on a one-to-one basis? good programmed 
courses are marketed to meet a variety of needs. However, 
no individualized courses and no computer-based .systems cun 
render superfluous conta-it hours between a human teacher and 
the leaner. 

No matter where a student lives, it is essential- to 
budget for adequate contact between the instructor and his 
charges. The human teacher is indispensable for a variety of 
activities involved iii language acquisition. Depending on the 
sophistication of a particular curriculum and the purooses for 
which t}-=5 language is being learnt, the teacher is ->eeded 
to solve problems which the individual learner does not 
: sliriiiouht unaided ' .. . 

to correct faults of 'pr'onunciation if desirable ■ 
to render, the student critical of his- own efforts • 
.to entsourage the student to use language creatively (free 

self-expression either orally or in writing) 
to guide the student in making constructive use df his time 
to orient the learner to derive the greatest possible bene- 
fit from the oedagbgical materials at his dii osal 
to motivate the tral.iee as required... 

The instructor complements the programme and fills 
in for such deficiencies as may occur. Thus, where the student 
can type in comments while working on the lesson materials, the 
teacher must be available to provide satisfa-.^tory feed-|?apk. 
Where §utomatfed lessons db not provide sufficient remedial texts 
and- do not arrange class room sessions, the adrainistrati-ve-wotk 
involved falls on the teacher. As a rough estimate, some 25% 
of existing costs for traditionally administered instruction 
will still need to be provided to complement any scheme to 
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automate language teaching. Provision must also be made in 
the budget for such retraining of staff as may be occasioned 
by the transition to computer-aided learning. This is not 
an area where the onus should be put on the teacher to seek 
further in-service training. 

The objectives of a particular French course deter- 
mine the teaching priorities and influence the choice of com- 
puter equipment and language facilities. If adults are to be 
taught no more than comprehension of the French periodicals and 
technical correspondence that come to their desks, there is 
no need to install costly equipment to handle speech input and 
output. When the teaching system provides such facilities for 
other reasons, it could become advantageous to play pre-recor- 
ded messages back to the student for pedagogical reasons if the 
added production costs are not disproportionately high* Neces- 
. sity and cost-effeptiveness are prime considerations in evalu- 
^ ^ting what ingredients should be made part of any particular 
computer- based educational installation. 

Again, no matter what the cheapest proposition may 
be in terms of efficiency and per capita expenditure, some 
school districts may simply be unable at any g^ven time to 
make' available adequate funds to meet the initial outlay. Op- 
timum solutions may remain illusory until cheaper communications 
and willingness to learn from others make inter-district and 
even inter-provincial boundaries irrelevant. Rivalry and am- 
bition could easily render meaningless any plans in the area 
of computer-aided learning. 

Given existing Canadian telephone company policies, 
it otMld well be that automated instruction in low-density 
propulation areas would be cheapest if conducted in terms of a 
small computer serving a hundred or so terminals. The MITRE 
Corporation claims that its TICCET system is unique in being 
able to handle up to 128 television screens at one moment, on 
the basis of "updating" (not refreshing) sixty student stations 
each second ' . While programming in a multi-purpose language 
like PI/1 can be time-consuming and hence expensive, the costs 
of developing an educational language would immediately increase 
the expense of the TICCET package. However, ^^hen teachers ex- 
perience too much difficulty or tedium in preparing lessons for 
the computer, they will allow the system to remain unused. In 

1. K.J.Stetten and others, Illfi,Dggign_aod_Jg5tiog_Qf_a-CQ50£= 
fQCtixg^CQmputSC-SxsliSl.CQC.the CAI/CMI ABElication, MITRE 
Corporation, January 1970, M69-39 Rev7"T7 pp7"iirand 10. 



n^oH.-Sf^^w'n^^ ""^^ equipment happens to get coui.d become 
prohibitively expensive in terms of cost per hour per student 

i'itnJ\t'^^^it^i°''^ i^^* ^« for evening ^cLIses !; 

beyond the eight-hour day of peak activity - tend to become 
quite cheap on a per capita basis. , "scome 

to Haf^r,a Hardwai-e essentials for lar.guage teaching are hard 
nntp? i^n;. ??^«^f^ective language instruction without a com- 
puter controlled scund source can be is evidenced by the Ger- 

af'q^nnS^^ r^^Ji"^''* University of New York 

at btony g-ook. Th.e control group followed an audio-lingual 
course with some sixty minutes per week in the language lab- 
oratory; in the xatter part of the first year students dev- 

^^'"f "° reading and writing. The experimental - 
f^o language laboratory -sessions, but worked from 

^oL^ilf °?.f^a??ng and writing skills with the help of a 
«,^?f^ ' J5® others, Wir classroom work followed the 
™onJr^^^''^\ pattern. All students had similar study assi^n- 
?n^mPH^- that CAI stiidents (85%) pet 

formed significantly better in reading and writing th^n the 

^?ea?^r'^f?-^- PopulSion is attributed tfthe 

pfA?^ teaching. Experience with the 

L I ^^u^^"" University of Illinois was similar 

for the teaching of French. CAI students rapidly became 
competent in translation skills, including phonetic transcrip- 
tions for French majors. Teachers compensated for wnat could 
not be done at the computer terminal. 

+-« no4-^« stratSgies could involve instructing a student 
to listen to pre-recorded tapes and discs or. to perform given 
n^neS.^«i?r*r^ exercises. The computer terminal nefd 

? h^^^ equipment installed to present such mat- 

tf.itil' Rosenbaum and S. Issakow produced 126 hours of a 
hn^^S-S^"^-^ r?^""® computer controlled a sound source, 
but their objective was to automate the acquisition of listen- 
i^fc-K?^''^??''^^^'^^''? dictation skills. It was therefore 
possible, though perhaps not imperative, to have aurally cued 
grammar exercises. Work with troops at^Monterey d^s not 
Sil Ll^^^T.^rh computer control of the sound source 

Whft^S^H^^if beneficial for learning dictation skills. 
wp?i ? learnt, they assimilated thoroughly and retained 

d« 1 rapidity. What can be questioned is the 

desirability of using existing computer techniques ;;o have 
students type Russian when tliey will later be required solely 

^ • ?°rS^^^» The DLI-TBM V'^^.iy.,H,^.r study in Gnmp i^ tPr-Ac , 

lubiwf?nr^f? Tn;tmrti1on (19^ 9), ibm g rt 259 5 

publication elsewhere could not be found. 
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to write freehand in that language. The type of equipment 
the computer controls at the student console could be best 
determined from the achievement objectives set for a course. 

The amount and nature of student terminals d* ~ide 
the minimum desirable size for the central processing • of 
the computer at the heart of a CAI system. Obsolete computers 
If bought cheaply can sometimes appear adequate for satisfac- 
tory teaching. One must be careful, however, that desired 
peripherals are not incompatible with the computer -or that 
unacceptably long delays due to the reduced size of the mach- 
ine make for unsound pedagogy. Usually the student needs the 
illusion that he is the sole user of the learning facilities. 
It is fortunate that IBM policy on rentals of obsolescent 
equipment is such that it is cheaper to implement COURSEWRITER 
III on their newer systems than, to look for 'bheap"alternatives. 

A major factor rih- the cost of CaI is the size, qual- 
ifications ar.d programming- time required by the writing staff. 
When off-the-shelf programmes are not available to meet the 
langu^e teaching objectives of a particular school or business, 
it is imperative to evaluate how expensive per student hour 
a CAI course is going to be,. In i .e case of i.he DLI Russian 
course referred to above, professional staff contributed 1271 
hours to initial authoring and 338 to revising materials for 
an average 12.7 hours for- each of 126 course hours. Such a 
low figure goes contrary to usual estimates for COURSEWRITER 
authors who ^.ra expected tc take eight to fifteen times more 
hours to prepare the finished programme. Adjunctive program- 
ming as a style i^ faster to achieve than other types and the 
guidance of Issakow undoubtedljr speeded the Work of authors. 
It vonld in aost cases be unrealistic to imagine that a teacher 
working alone in producing COURSEWRITER III materials- could 
match such an achievement. Feeding partially written course 
material to a professional programmer "* or to a type of pre- 
compiler like VAULT at the University of Alberta could diminish 
expense cons jd er ably ^, Such a proceeding relieves CAI lesson 
writing of much of its tedium and repetitiveness. The use of 
"macro" instructions has a similar effect on authorship 3. 

1. M.W.Dowsey, lovar^s.a.Tcue^Author Entry System for CAI, 

PrograiDm9d_L9aroii«.aoa_Eauca£iQDsirTfic5oclQgf"7"rT970) 
I'P. '+3-55 tries to resolve the dilemma of the author who 
does not want to learn how to code his lesson for the com- 
puter. He favoiirs the work of '^'^an and Grubb at San Jose. 

2. W. Birtch and others. yAULT.CQ0Cfifi£5-aDa-£scili£iSS, fidmon- 
ton, 1969, 2M- pp. and Research and Information Report VAULT. 
Apart from provision made in a ianguagi3"iIki~C50RSOTITER"'lll 
see A_^crQ-Sy5tSl&-fsi:_CAI, US Army Command, 1970, 72 pp. 
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The TUTOR language used with the PLATO project at 
the University of Illinois has in fact altered traditional 
estimates for the time required to produce a CAI lesson. It 
is generally asserted that a teacher will learn che basic 
techniques of writing in TUTOR in some five hours or so at a 
student terminal. One teacher who wrote 3 teachidg hours for 
the computer took some 26 ho\irs to create the lesson. What 
a language teacher would require to write a listening compre- 
hension lesson in French for PLATO IV remains an unkr).own, but 
it is likely to take no more than RosenbaTim and his associates 
took for the DLI Russian programme. The figures involved are 
therefore comparable to acceptable estimates for text-'book 
writing, especially when distributed over the writing of a 
year *S' course and not limited to a demonstration lesson. The 
availability of specialized consultative nelp for certain 
aspects of course authoring makes for more effective and fast- 
er lesson production prior to initial presentation to stud( ts 
and diminishes the amount of revision needed subsequently. 

In 1971, J. Brahan of the National Research Coancil 
suggested that a sample segment of the Langmge Bureau French 
programme be adapted for computer presentation using CAN, The 
presence of st?.ff from the Ontario Institute for Studies in 
Education for two days while we became acquainted with the CAN 
language and wrote the main subrToutines for the presentation 
of instructional and t€ c sequences greatly speeded this asoect 
of the course preparation. The subsequent work of producing 
the tape-script and the written text, of devising visuals and 
of haviig recordings made, of editing and addressing the audio- 
visual source materials was a team effort requiring the collab- 
oration of many services. The adaptation of CAN for language 
teaching goes hand in hand with developments in available hard- 
ware and the redefinition of what aspects of language teaching 
can be automated at a given stage of development. The more 
disparate elements are to be integrated into a single lesson 
presentation, the longer it will take to produce the course. 
On the other hand, the more effective the instruction, the less 
will be the time taken by the student to achieve criterion 
levels of performance. When a CAI curriculum is designed, it 
is misleading to calculate costs solely in terms of the hours 
taken to prepare a one hour lesson for the student. Surely the 
only valid measure to allow comparison with traditional forms 
of instruction takes into accoimt the time students require to ^ 
achieve the same objectives with the help of a computer. When 
students reach their goals in half the time required for class- 
room instruction, -eduoatibnal expenses are likely 1:o be reduced 
in a variety -of ways. 



Even if CAI programmes written by this or that 
pedagogue can be proved more efficient teaching tools which 
make for better retention of content, more effective develop- 
ment of basic skills and all in a fraction of the time required 
in the schools of a given locality, the money spent in leasing 
or amortising purchased hardware is excessive with the comput- 
er configurations to which we are accustomed. Besides, their 
very efficacy creates problems: what are we to do with the 
twelve-year old who qualifies to embark on University studies? 
How can we cope with employment needs of twenty-year old PhDs, 
M.D.S and the like? Is Canadian society anxious to pay for 
accelerated development? The savings made in reducing the 
*59f *° state-subsidized formal education are liable 

to*^ lost through provincial grants to very youthful unem- 
ployed graduates. Only government and business agencies can 
derive immediate profit from training management to speak the 
second official language more efficiently and quickly. 

The team at the Ontario Institute for Studies in 
Education who gave us the CAN family of computer languages 
subsidize Canadian CAI teaching. In the United States, one 
of the major costs most institutes engaging in CAI faced was 
the creation of a satisfactory tool for teaching. In Canada, 
users of CAN who meet programming problems can get tailor- 
made improvements to available facilities through cooperation. 
National Research Council work on hardware also ensures that 
taxpayers' money is used to best advantage. Experimental 
equipment for use with the NRC PDP-10 currently involves costs 
of the order of ^J10600 for each student terminal and a like 
figure for basic interface hardware permitting coramimication 
at 1200 bit/sec. These audio-visual terminals include unique 
features like the touch-sensitive graphic input device designed 
by A.M.Hlady '. We can be confident that current work on a 
speech input device will in due course make language teaching 
even more flexible than it can be today. 

t Such CAI schemes could be classified as ad-hoc frame- 

oriented teaching systems where the programmer specifies sub- 
ject matter for the student, poses particular questions and 
devises strategies for coping with individual foreseen wjswers. 
J. Carbonell contrasts these approaches with information- struc- 
ture-oriented teaching 2. in this most sophisticated of inter- 

1. ^ll-2=X»T2ii2jj_Seiisi1iive Position Encoder for Computer Input, 
5ulletln_of _Radig^and Blectr lcal"EngIneef ing~DivIsIon"T9:" 
1969. no 3, pp. 15-T9 ' 

2. iJl2§3:lQ4tiatiYe Mao::C2SBUter_Iostructlonal Dialogues, Cam- 
bridge U-Iass), Bolt, Beranek & NewmaH"IHc:7"reporc"T97l ,1970 
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active systems, instructors allow the student initiative in 
utilizing the computer resources at his disposal and the con- 
ception of automated instruction changes. The student can 
consult a network of facts, concepts and procedures; at the 
heart of the system is what we might call a "semantic" grid 
which interrelates the iKis. Lexical units are type.oijdes 
when they point to an informational, multi-level list; they 
are tokeO-DOdss when they refer back to one of th'e types. In- 
formation in the programme is stored once only without redun- 
dancy; synonyms are stored as such. Each element is catego- 
rized by specifying a set of properties: the name df the 
attribute, the tags necessary for its correct use and the Aral- 
ue of the property (a set. of properties or a pointer to a 
(set of) unit(s)). While (^uillian on whose work such a system 
deperied for its elaboration now chooses to make his whole 
semantic network a net of pointers , it is desirable for 
practical purposes to differenciate iype and token Dfldss. The 
SCHOLAE system provides for the teacher to input the relevant 
subject matter, to define the conditions for student-computer 
interaction and to specify what data he requires on the learn- 
er's behavior. The student working with the computer can 
answer the computer's questions, pose his own and receive in- 
formation or be tested on his knowledge. Some hundred or so 
stereotyped sentences of consdiderable variety complement the 
lexicon and allow print-outs like: "You have made ... mistakes. 
I suggest you devote more study to ... i' The implementation 
of SCHOLAR on a PDP-io makes for acceptably .-.uapid interaction 
between the student and the machine, but its effect on cost- 
effectiveness is difficult to calculate. 

A similar type of facility is "dialog" within the 
context of the PUTO project at the University of Illinois 2. 
As implemented for the large-scale PLATO- IV version, infor- 
mation- .-:^ructure-oriented teaching is only one aspect of the 
TUTOR i. -.guage conceived by P. Tenczar. A variety o*f foreign- 
language co'orses are taught with great efficacy. K. Myers, 
R. Ariev and others have adapted F. Marty's 4cliiYS_Fi:gD5b pro- 
gramme and made it the foundation of undergraduate" instruct ion 
in the language. At this stage, active updating |of the comput- 
er programme from the PLATO- III to the PLATO- IV version is in 

(AD 707 782). While not the only statement of the pedagog- 
ical technique, this paper in its 211 pages is the clearest 
available of this type of computer-based learning. , 

1. M.R.guillian, iJemaDtlS-Mesory^ Pittsburgh, Carnegie Instit- 
ute of Technology PhD thesis, 1966 and Tfae Teachabje Lan- 

guags«CQm,-prelieD(ieci-a-r>imulatiou.£rogram-aQdIlbeQrylQfILaQT 
euagg, Qo!nm._of^the_A^C^Mi 12, I969, no 8, pp. h^9-U76. 

2. J.R;.3kin, wjji5|en_C2S2osition_and_the Comguter, Urbana, 
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progress and F. Marty is devoting considerable effort to 
developing listening comprehension lessons for the course. 
Author costs could be m6t by a charge of three cents per 
student per terminal-hour which would guarantee the equiv- 
alent of royalties cn a publication. Publishing and distrib- 
ution costs met iJi printing houses are here incurred by the 
Institute providing the CAI lessons. The latter "sell" them- 
selves in the measvire that they are effective tools for 
learning a language. What justifies the initial investment 
is the high prospective enrollment. In the last analysis, an 
Institute must budget for its hardware and software costs in ' 
the context of the allocation for teaching which also co,mprise3 
contact between teachers and their students. However cheap it 
may be to write lessons, however effective may be the simulat- 
ions £ind pupil-machine dialogue, however many times aore effic- 
iently certain linguistic skills may be acquired through TUTOR, 
the PLATO-IV system may not be economically feasible outside 
the sphere for which it was created. What is* ideal for large- 
scale use in high-density population areas must* be analysed 
anew when Canadian teaching involves sparsely popule.ted regions 
where communication charges render a remote computer prohibit- 
ively expensive to use at all. 

Language teaching can involve a limited number of 
types of exercises and tests and a limited nu&ber of contexts 
appropriate for different groups. Skeleton programmes can 
devised which require of the teacher to specify what hjs par- 
ticular objectives are, the age and interests of his students . 
and the type of equipment locally available. A French pro- 
gramme conceived in such terras could then conceivably be 
implemented differently in various locations and meet the 
specific requirements of each user'who makes his own contrib- 
ution to the design of the programme adopted. It is illusory 
to imagine that one can quickly adapt a given text-book or 
even programmed course. CAI involves completely different 
strategies and has to be designed as such from the start. The 
mere use of a computer as though it were a kind of primitive 
teaching machine dispensing pr-^graramed instruction is doomed 
to remain an unjustifiably expensive game. ITie design of 
"drive" components for PLATO, "module" formulation for the 
DLI Russian programme- or CAN sub-routines mentioned above rcake 
CaI capable of adapting lessons to the learner eind justifying 
the expense of nan-machine interaction. . . 



University of Illinois, 1971, CKRL Report X-ii, pp. k ff. 
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TllE TE/tCHER-AUTHORED IXSTRUCTION' MANAGER (TAIM) SESSION 1/.A 

By/Par: K. Kestrom, ROOM/SALLE US 
University of Alberta. 
Universite de I'Alberta. 

the reeular Ji^^.r^i^'^u"^ °^ computer programs that are designed to provide 

the reguxar. classroom teacher with the means to use a computer as an instruction- 

"Lt'of'S'-"; curriculum; r'ther. th. teacJer^st " 

supply a set of displays, tests, and logic to the computer. The computer th^ 
assembles the displays and tests according to the supplied logic to provide 
.individualized output for the students. TAIM has facilitii^s for scoring tests and 
keeping records of all transactions. It provides the teacher with advance^a^nS 
of student assignments and allows the teacher to. over-ride the resident iLic ?^. 

tl^^'^L'^^AlTmo^^t'o/ '° r."^ " '"^ tlTtsTrT^lciriky 

tine, and ^AIM monitors such changes to ensure that faulty logic is not included. 

t. > J- Displays may consist of any printed material. This would rancre frnn, 
Snl'Lftr" T ' "^"^''^iP - portlSn oHext) to detaned 

s^^^^^^^^ 

f^u u ^^"^ "^^^^ system, a classroom teacher may be exoecteH tn imnrn^^ 

PR0CRA>OES POUR AI DER LE PROFESSEUR DANS SA FOXCTION DE GESTION (TAI>n 

de classe S^ILvelTH'.^^r programmes congus p^ur donner au professeur 

de Classe le moyen d utiliser I'ordinateur pour I'aider dans sa gestion. TAIM n'a 
pas de programmes fixes; c'est au professeur de fournir des afffchages des'tests 
et u^-logiquc a 1 ordinateur. L'ordinateur rassemble alors les affSges e le' 

oSu "noSr df T ""'"''^ ' ^"^''"^ individuillenen ! 

n™f^..^ur , % enregistrer toutes les operations. II signale a I'avance, 

au professeur. les devoirs des etudiants et lui permet de passer outre la lo^ique stockee 
S ""^"^^'^ affichages' les tests ou la fSgSque 

et TAIM verxfie ces changements pour ^'assurer qu'une logique erronee ne s'v tSuve pas. 

braves fnasser u^f?!^*"^ •"'^"'"'t ^"""^ d'imprimes variant entre des directives 

LI^^L^^f r . . "^''"'^ " '^^^ explications detaillees d'un concept. 

Us tests dolvent prendre la forme d'un choix multiple ou avoir des reponses m"is 
les notes donnSes par le professeur peuvent .:tre aussi affichees La wJque so 

SJJaL secSS? dL ''ff/J:'^"'^' avertissement que I'ctudiant a commence une 
conrtiMn affichages ou messages conditionnels et des derivations 

conditionnelles ou non vers d'autres secteurs du fichier de la logique 

En utilisant le systSme TAIM, le professeur de classe peut s'attendre a 
une amelioration (par des evaluations formatives repctSes) de ses Je^ons et de leur 

rrysrs;eTMno^'t :™ettr '^''"^1 " - '--"l^^' "«=hie-. 

et ln?"rdJJlse P^"'^"'^^ ^" professeur de pouvoir donner un enseignement efficlce 
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THE TEACHER-AUTHORED INSTRUCTION MANAGER 

The Teacher-Authored Instruction Manager (TAIM) is a set of 
computer programs which facilitates a Computer Managed Instruction 
(CMI) environment. Where most CMI systems of instruction available 
. to- date restrict and are dependent upon the nature of instruction for 
which they are used, TAIM may be more properly considered as a teacher 
tool. That is; while the communication links between teacher, computer, 
and student are defined by TAIM, the nature, scope, media, mode, 
sequence, and rate of instruction are riot. 

In effect, TAIM is an instructional assistant with the 
following capabilities: 

1. storage of teacher-prepared lessons and tests, 

2. storage of teacher-prepared decision algorithms (decision 
algorithms are the rules by which it^is decided which ^instruction an 
individual student will receive ^neict),, 

3. - retrieval of .specific lessons, and te for individual pupils 
according, to the particular decision algorithms he or she. enccanters, 

4. automatic scoring of multiple .choice, and integer-value-answer 
tests , 

5. automatic storing of test scores and student sequences, 

6. rapid retrieval of specific information on students and across 
students, and, 

7. easy modification of lessons, tests, decision algorithms, and- 
the sequence of individual students. 

. . One of the main criteria in the design of TAIM was the 
division of necessary teaching tasks into those capable of being don3 " 
by computer and those which require human attention. The majority of 
a teacher's duties are complex; of these, a good portion are such that 
algorithms can be devised for their execution. The computer is not 
capable of devising. algorithms, nor of ensuring that they are working 
properly - these jobs must be done by a human. But the computer is 
naturally more adept and efficient at executing complex orocesses that 
have been prespecified. in an individualized setting where the 
teacher -s time is at a premium, it is clearly useful to free him for 
tasks which ne alone can do. 

There are three broad categories of tasks that fall to a 
teacher using TAIM: 

1. devising and revising instructional material and algorithm 
rules for the computer to execute, 

2. monitoring the actions of the computer and the reactions of the 
students to ensure that instruction is proceeding effectively, 

3. giving individualized personal aid to pupxls when their instruc- 
tion as supplied -by the computer has failed, diagnosing the reason for 
taiiure, and making the appropriate revisions to the material and/or 
algorithms. ' 
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The following section 'The Structure of TAIM* discusses the 
ways in which the teacher prepares, infomation- for storage in the 
computer • The section 'Lesson Production* presents a description of 
how the computer assembles individualized lessons fpr students from 
this information, and how conpuni cation between teacher and students 
through the computer takes place.. Under 'Online Capabilities'^ the 
teacher's power of control over the computer is made explicit and the 
mechanics of the teacher/computer interface explained. The final 
section of this paper attempts to predict the impact for education 
of the TAIM system. 

The Structure of .,:TAZM ^ . 

TAIM keeps about ten information files on random, access disc 
storage attached to the com]puter. Of these ^ -fovir are ceiitral to the 
operation of' the' system: the Display file, the Test 'file, the Records 
file, and the Logic file. Each of these .files is partitioned into a 
variable number of 'units'. Each unit is labelled so that it may be 
re£erred./to by both the TAIM user ^ahd^the computer programs. Units of 
different files may have the same label; where confusion might arise, 
the labels are prefixed with D- (for the Display file) , T- (for the 
Test file), R- (for the Records file), or L- (for the Logic file). 

TAIM keeps one set of these files for each grade group using 
the system. However, as individual students meet or do not meet the 
criteria set for them by the teachers/ they are channeled to different 
portiop::* of these files. In a sense> the Logic, Display, and Test 
files specify a curriculum for the course? individual students proceed 
at different rates and respond differently so that they access 
different parts of the total course specification. The Records file 
keeps track of their past auid present positions, and their Test results. 

The Display file has the simplest structure of the four. Each 
labelled unit is called a Display and consists of a variable number of 
lines of textual material. Displays are printed out for students on a 
high-speed printer by the Offline computer program. The contents of 
Displays may range from short instructions to a student (to read a 
portion of a textbook, view a filmstrip, meet with a resource person, 
etc;) to lengthy discussions of concepts. In short Displays consist 
of any printed material that a teacher might wish to be given ^o an 
individual student. 

The Test file contains a variable number of labelled units 
called Tests. Each Test has two parts: a textual part and a •weights' 
part. The textual portion is similar to a Display and is the part 
printed out for students • This part would normally contain a number 
of test questions and instructions for the recording of responses to 
these. Since the responses must be capable of input to and analysis by 
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the computer, the questions are restricted to either multii:,le choice 
or integer-value-answer variety. The Weights part of each Test con- 
tains coded information for the marking of student responses, and so 
constitutes an answer key to the Test. 

The Rfacords file contains a unit for each student registered 
for the course. Each unit i's called a Student Record ard is labelled 
with a student's identification, such as the first five letters of his 
last name followed by. two initials. These records contain registration 
.information (such as the student's age, sex, grade, home room number, 
etc.) and a complete record of all lessons (Displays and Tests) he 'has 
taken, the marks for all Tests, and a jpointer indicating which lesson 
he is to be given next. (it also contains NOTE and HOLD information 
discussed in section three of this paper.) 

The Logic file contains a variable number of labelled units 
called Days. Each bay consists of two parts: a lesson part and an 
algorithm part. Each part contains .coded statements which control the 
assembly of Displays and Tests into individual printouts or specify 
the decision algorithms; each coded statement consists of a keyword 
followed by a number of paurameters. 

When constructing a lesson for an individual student, TAIM 
proceeds by writing the student's name at the .top of a page, locating 
the particular Day that the student is at, and then executing the 
coded statements. sequentially. The possible coded statements for the 
lesson construction are: 

SHOW D-label This statement causes a printout of the contents of 
the Display labelled D-label from the Display lile 
to be made. 

TEST T-label This statement causes ,a printout of the textual 

portion of the Test labeled T-label from the Test 
file to be made. ^ 

MESG "message" when an individual student encounters this statement, 
his name, the date, and the "message" are sent to 
the teacher. By placing these appropriately, the 
teacher can cause the computer to warn him of 
occurrences that require his attention. Eg: a 
student entering a difficult section. 

IF (Condition) SHOW D-label The if statement is used to cause a 

IF (Condition) MESG "message" conditional Display to be printed 

or message to be queued. Although 
many possible forms of Conditions 
are conceivable, the current version 
of TAIM IS limited to comparisons of Test results and counts of the 
number of times a student has passed through a particular Day of the 
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Logic file* In a Condition, an L-label represents the number of times 
the particular student has been given the named Day; a T-label repre- 
sents either the student^ s total or his percentage score on the named 
Test. 
«-* 

Conditions may^ be either Single Conditions or Double 
Conditions. The Single Condition may be either (L-labei R Value) or 
(T-label R Value) where the L- or T- labels take the values described 
above, R is replaced by one of or <=, and Value is 

replaced ;by a non-negative integer with an optional ger cent (%) sign 
following. The Single Condition is True if the value of the label 
bears the R relatij^nship to the integer Value, False otherwise. If 
the s:tudent has not encountered the L-label, or has not taken the 
Test pamed by T-lcO^el, then the Condition is :always False . 
Examples : Suppose a is tudeht has encountered^ L-CHAP3.1 twice, and 
received 12 out of 20- marks oh tes€ T-GH3.r - then; 
(L-CHAP3.1 > 1) would be True for this student, 
(T-CH3.1 < 15) would be True for this student, and 
(T-CH3.1 < 15%) would be False (his %-mark is 60%). 

A Double Condition consists of two Single Conditions joined 
by either AND or OR. If the connector is AND, then the Double 
Condition is False if either (cr both) of the Single Conditions are 
False. If the connector is OR, then the Double Condition is True if 
either (or both) of the Single Conditions are True. The Double 
condition is always False however, if either (or both) of the labels ^ 
have not been encountered by the student. 

Examples: (L-CHAP3.1 = 3 AND T-CH3.1 > 50A)_would be False, and 

■ (T-CH3.1 > 10 OR L-CHAP3.1 < 2)' would be True. 
T-labels ma^r be used to refer to portions of a Test by placing 
question numbers after them. T-CH3.1(1,2,8,9,10) would take a value 
equal to the total- of the marks for items 1,2,8,9, and 10 of Test 
CH3.1 or the percentage of this total over" the total possible marks for 
these items. 

There is clearly a variety of possible extensions to the pro- 
posed Conditions. However, the means of constructing Tests and 
inputting data make the possible T-label values quite flexible. For 
example, if a teacher wished to discriminate of student I.Q. , he could 
make up a single question test, label it 'T-IQ' , and then code and 
read-in cards with each student's actual I.Q. on them. Afterwards, 
any Conditional statement such as IF(T-IQ <= 110) SHOW REV3.3 would be 
processed appropriately. 

The second part of each Day in the Logic file contains the 
decision algorithm specifications. There are only two acceptable 
statements: 

GOTO L-label This statement causes the student's next- 

lesson pointer to be changed to L-label. 
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WHEN (Condition) GOTO L-label This statement .causes the student's next- 
lesson pointer to become L-label if 
the Condition is True. Condition is 
defined as above. 

These statements are used to determine which Day a student 
will be assigned to when he has finished the current one. The state- 
ments are examined sequentially (for each student) until the next- 
lesson pointed is set by a WHEN statement with a True Condition or by 
a GOTO statement. Each Day must have exactly one GOTO statement which 
IS last in the unit. There may be any number of IVHEN statements. 



Lesson Production ; 

There are essentially two steps in the production of lessons 
for individual students under TAI'4. These steps correspond to the 
two parts of each Day in the Logic file. 

The first step occurs when TAIM consults the next -lesson 
pointer of an individual student .to determine which Day he will receive 
This Day is looked «p in the Logic file and the lesson construction 
statements found there are executed. The student receives his lesson 
printout, does the indicated work, and turns in a computer card. If 
the lesson contained a Test, the student should have penciled his 
responses on this card. 

Step two occurs when the card is read by TAIM. If a test 
was given, the student's responses are marked and the results stored 
in the student's Student Record; then the decision algorithm part of 
the Day is executed and the student's next-lesson pointer set 
accordingly. 

Although these steps are closely related, they are executed 
at different times by different programs. Step one occurs during an 
overnight off-line program run. When this program r.tarts, all 
students' next-lesson pointers are determined and available. Lessons 
are printed for students on the high speed printer through inter- 
preting the necessary lesson construction statements. When finished, 
the program leaves all students' next-lesson pointers undetermined, 
(that is, not pointing to a next lesson), but keeps a record of the 
algorithm statements to be processed to determine the pointer for each 
student. _ * , » 

The next day, the bundle of lessons is delivered to the 
school and distributed among the students. After doing their assigned 
work and preparing their computer cards, these cards are read-in by 
TAIM. The READ program marks all necessary Tests and then interprets 
each student's decision algorithm statements to set their next-lesson 
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pointer. That evening, the overnight program runs again and the 
cycle repeats. 



(Interval 1) 



OVESNIGHT 
Program Runs 




READ 
Program Runs 



Interval 2) 



During both intervals 1 and 2, the t-acher may execute other 
online commanas of the TAIM system'. These com^aands are outlined" in 
the^next section; they allow the teacher to gathei information about 
student performance and the contents of students' lessons, and to alter 
student s next-lesson pointers. The two figures on the following page 
diagram the operation of the overnight and READ programs. The figure 
following these shows the communication links between the school and 
the central computer (a telephone line and a courier delivery service) 



Online Capabilities 

under TAIM, there is one offline program (the overnight pro- 
gram) and a nuinber of online programs. The term 'online' indicates 
that these programs run under the control of a user via a remote 
terminal, where the offline program has a single duty (to determine 
and print a lesson for each studsnt) , the online programs are divided 
into the Mode 1 programs, the Mode 2 programs, and the Mode 3 programs. 

Using Mode 1, the teacher may collect and print out data on 
the students and the four main files, and may alter the sequence of 

in!^r^!i°"/°\'"'^''^^"^"^^^ °^ °^ students. The Mode 2 programs 

enable the teacher to modify the Logic, Displ'ay and Test files. The 
^T^^;"o " ^ natural one; Mode 1 is used to run the TAIM system, 
and Mode 2 to alter .its operation. The Mode 3 programs consist of 
caretakmg and initialization routines. Their use requires an under- 

architecture of TAIM; they will not normally be access- 
able to the teachers, and are therefore not discussed in this paper. 

Mode_l would be accessible to all teachers using TAIM. As 
lnZ.t%^ "^"^ signs-on to Mode 1, he may issue any of thirteen possible 
commands. One of these, READ, runs a program to read-in student cards 
(d .scussed previously). The remainder can be divided into three sets- 
student monitoring, data gathering and miscellaneous programs. 

The student monitoring commands allow the teacher to alter 
the lessons assigned to the students by TAIM. The command NOTE allows 
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STEP ONE OF LESSON PROCESSING: CONSTRUCTING THE LESSON 



initialize 
NEXT-STUDENT 
Pointer 



NEXT STUDENTS' 
Records * 

lesson pointer. 
Find 'Day' in 
Logic file. 



Initialize"" 
NEXT-STATEMENT 
Pointer 



I 

.s xart making lesson . 



■finished, this student. 



Get 

NEXT-STATEMENT 



f 



.„ ^Yes ^ /1s Condi tiofKNo 

IF? M TRUE? ^ 

W6I ^nCEST 



( SHOW? J 



Yes 



r TEST? ^ 
^ 



Yes 



^ MESG? ^ 

-m 



Yes 



* STOP - when all students have been processed. 



^ Look-up lata! in 
v\ Display File and 
print-nut. ni«tplav. 



Look-up laoei in~" 
Test file and 
print text portion 



queue message 
along with date 
& student code. 



STEP TWO OF LESSON PRnrFSf; iNG: SETTING THE NEXT-LESSON POINTER 




* STOP - when none left. 



Get Test key 
from Test file 



Score test and' 
record marks in 
'student's record. 

/ 



^ aet NEXT-STATEMENt 



^ WHEN? 



must be GOTO 



Initialize 
NEXT-STATEMENT 
Pointpr 



^ No/fs condition^Yes 
V TRUE? J 



Set next-lesson 
Pointer. 
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the teacher to place a conanent in any student's Student Record; this 
comment is then printed at the top of that student's next lesson. 
HOLD allows the teacher to suppress the lesson printouts for students 
This might be used if a student was to be absent for several days, or 
If a group of students were to miss their regular classes for some 
reason. The POINT command allows the teacher to change any student's 
nextrlesson pointer. This might become necessary if the decision 
algorithms have placed a student on a path which the teacher felt was 
not appropriate. 

The data gathering commands allow the teacher to print out 
information from the files. 'Al.ere are four of these. PRINT is used 
for several purposes: to print the teacher messages generated by the 
MESG statements in the Logic file, to find out which students have 
been NOTEd, or are on HOLD, and to print selected portions of the ' 
Logic, Display, or Test files. The MARK command allows the teacher to 
retrieve the marks any student received on any past Test; the TRACE 
command permits the tracing of any student through the labels of any 
past- Days, and the WHO command can be Used to tell which students have 
taken a particular Day or Test. 

Two other student monitoring commands are REGISTER, and 
UNREGISTER which simply add or delete Student Records from the Record 
file. The three miscellaneous commands are available in both modes 
1 and 2; thay are: MODE which allows the transfer between modes, 
STOP which simply stops fht TAIM system, and WHY. Whenever a user 
issues a command, he gets a reply of either DONE or NOT DONE...#, 
where # is the number of an- error message. The command WHY causes 
t e message to be pri!^ted ouc. 

Mode 2 will not normally be accessible to all teachers. This 
IS because the modification of the Display, Test, and Logic files must 
be done very carefully - by someone who has a good granp of the 
mechanics of the TAIM files. 

When making up a Day for the Logic file, the teacher will 
typically think in terms of one day of instruction for a student. 
First-, a presentation must be made; the student rrust be given some 
content. The teacher can examine the existing Displays to see if 
there is one or more available to suit his needs, if additional 
Displays, such as further explanation, directions for supplementary 
material, or a set of exercises are needed, these must be constructed, 
labelled, and inserted into the Display file. The teacher may de- 
cide that a quiz on the content is appropriate. If one is available, 
xt can be used; otherwise a Test must be constructed, labelled, and 
inserted into the Test file. 

With the necessary Displays and Test available, the teacher 
can begin construction of the Day with SHOW, t;2ST, and MESG-statements. 
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more of the existing Days! modifying one or 

Care must be taken to ensure that all n^oo lu 
and exits, and that ail units are PW^Sf lai^Ued ^Sd ? ^"''^^^^ 

?H=or%f ^^^^^^ 

can construct' ;S'unitTh%':i''eT T '""T*"^ 

these, but the o^ly iiy Jo W L"^^ ^^^'^^ 

files IS through tL S^VE cS^J^Lf n.J?*'™"*^^*" °^ ^^'^ permanent " 

on all synt«! ^^^^ '^^^^"'^ "^""^ * thorough check 

the temporary workspaces, then iSS ^Epf^S .'^^^^ °^ 

to add-, n^ify or remove lines fr^ I; ^J^^''^' '''^ "^ed 
the purpose of retrteJIng data frZ tt f *" """^ 

print the contents orHorJ^Lce or J /""'^ ^ "^^"^ ^° 

used to locate (in Permanent unit, and FIND can be 

to a gIven'JiLi:" ^of e'^a^^rTf'H^a"^? 

FIND REVS would 'find' allD*!« tLT^ Display lab^i, then 

REV3 and pri^t out'heir LLL. ''"'^"^"^ 

Simply Places" Sov'^r.""^""" ""^^'^^ '^^^^S^'y- ^^^CE 

anTi^B^L is used ?^ ^ssLrna^J °' workspaces, 

?"ts!° .r?o^„^:^: cS.^af - - with 

temporary files. Note that if a label 7= », V pornanent or 
then all references to tha^ lab^l^^i .1 yl'^^t °" ^ ^'^^'"^"^^"^ ""it, 
this automatically. ?he Sree eiaTuati«i ° "'^Z''^''^- 
EVALUATE, and SAVE. SkUTE L ^ are: EXICCUTE, 

teacher.' For eJI^^le^^f ,"^st"an^ ExL'JTIh"^'"^'"^''^" 

for responses which a^e marked and^ri^Sd oS; klT'^'l 

if the Test is being marked properly ^^lSa^; / 

evaluation, ensuring that alfrXere^cef^el^ tT f ,^^"^^^^^^^='^1 

e^pr^ha^^f-n" L^^^^^^^^^^^ 

workspace's, are^c^'K ITJ^^I^^^^^^^^^ 
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miscellaneous coinmands are MODE, STOP, and WHY. These were described 
in the Mode 1 section. 



Expectations 

It should be clear that a teacher using TAIM will not have 
less work to do because of the system. For the first one or two years 
he would probably have more. One distinct advantage that TAIM- can 
offer is to make the teacher's work cumulative both quantitatively 
and qualitatively. Consider the quantity of lessons a teacher prepares; 
there must be. at least two hundred per class per year. Yet few if any 
of these are saved for use next year, still fewer are transmitted to 
other teachers. Under TAIM, all would be saved and available. 

However, quality is the more important factor (it is of 
little use to save poor lessons). Using current methods, a teacher 
about to present, a lesson might attempt to recall how this or a 
similar lesson worked in the past. Identifying imperfections, he may 
try variations to improve the presentation. Clearly, the time to do 
such formative evaluation of a lesson is immediately after the presen- 
tation - not a year later. Under TAIM, this is not only possible, but 
should be defined as one of the teacher's main duties. Since the lesson 
xs kept intact between evaluations, it is reasonable to expect that it 
will improve from year to yeeir. 

Another advantage of using TAIM is the system's ability to 
automatically store and retrieve information concerning individual 
students. A teacher constructing individual lessons may be able to 
say: "a student reaching this point should take either lesson "A" 
or lesson »B' depending on factor »X'." Yet at some later time, the 
teacher will have difficulty both recalling the rule and locating 
xnformation on the relevaht factor. TAIM overcomes this problem by 
allowing the teacher to define the rule, saving it, and then auto- 
matically retrieving the required information and executing the ru3e 
whenever a studt^nt reaches the specified point. Further, the same 
sort of formative evaluation can be done on the rules as was done on 
the lessons. 

The third distinctive advantage of the TAIM system is that 
it effectively eliminates a major portion of a teacher's tasks - 
those tasks which can be done by machine. This is expected to cause * 
the teacher to focus on his unique talents i providing students with 
the human contact that cannot be simulated, and providing the super- 
vision and continuous monitoring that the computer needs to remain 
adept at its job. 
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APPENDIX - ONLINE COMMANDS 



MODE 1 USER CC^IMANDS 

READ - reads in student cards 

Stijdent Monitoring 

NOTE - place a comment in Student Record 
HOLD - suppress offline printout of a student 
POINT • alter student's next-lesson pointer 
REGISTER and - for student registratidfi 
UNRE6ISTER 

Data Gathering 

PRINT - print selected file contents, MESGs, NOTES, HOLDS 
MARK - print out student's Test marks 
TRACE - print out student ^s past L*labels 

WHO • print IDs of all students %^o have 'hit' a certain label 
Miscellaneous 

MODE - to change to mode 2 

STOP - to get out of the TAIM system 

WHY ~ to escplain error messages 

MODE 2 USER COMMANDS 
Edit Comnands 

EDIT - to 'get' a tenqporary workspace 

INSERT ~ to insert a line in a temporary workspace 

REPLACE - to replace a line in a temporary workspace 

DELETE - to delete a line firom a ten^rary workspace 

Data COTinands 

PRINT - to print out information from the files or workspaces 
FIND • to locate all references to a given label 

Evaluation C(xnmands 

EXECUTE - for semantical evaluation of units by the teacher 

EVALUATE - for syntactical evaluation of units by TAIM 

SAVE - to copy temporcury workspaces to the permanent files 

Service Conmands 

PLACE - to copy a permanent unit to a workspace 

LABEL - to label a workspace 

WEIGHTS - for automatic coding of Test keys 

CHANGE - to change labels 

Miscellaneous Commands 

(see above under Mode 1) 
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A LABORATOR Y FOR CAI LESSON RESEARCH & DEVELOPMENT SESSION 14B 

By/Par: Gary M. Boyd, " * ROOM/SALLE 145 
Sir George Williams University. 
Universite Sir George Williams. 



One promising approach for research and for the development of CAI 
lessons is to record, analyze and edit protocols obtained from actual tutorials. 

A laboratory has been designed and constructed at SQ^ with three student 
i^^^^i r^'^^'r The tutor is linked to a student by closed circuit 

TV by a dual keyboard computer terminal (LEK III) and by an audio link. 

Tutorials are recorded in computer files on the SGW CDC CYBER70 (6400) 
system and on videotape. 

The protocols are used to determine the number and variety of questions and 
answers required for efficient programmed instruction (curriculum and lesson design). 
It is hoped eventually to use the protocols as a basis for developing algorithms for 
generating problems and solutions. • y h ^-^^ 

u 4 laboratory has been in operation since Dec. 1971 and tutorials are 

being conducted in aspects of English as a second language and on topics in the SCOT 
Humanities of Science programme. (Results of preliminary evaluation of programmes 
produced on the system will be given if available). ^ - 

UN LABORATOIRE DE RECHERCHES ET DBVELOPPEMENT POUR 
ENSEIGNER A L'AIDE D ' ORDINATEURS 

Une manifere interessante- de se servir des legons utilisant I'ordinateur, 
pour la recherche et le developpement, consiste !k enregistrer, ^ analyser et S 
editer des "protocols" obtenus d'echanges reels. 

A la SGWU un laboratoire a ete construit comportant trois cellules pour 
les elfeves et une pour le professeur. Ce professeur est relie S I'etudiant a I'aide" 
dc la television en circuit ferme par un double clavier ^ un terminal d'ordinategr (LEK- 
111) et par un ligne d*ecoute. Les legons sont mises en memoire dans I'ordinateur 
CDC CYBER 70 (6400) de la SGWU et sur magnetoscope. 

Les "protocols" servent ^ determiner le nombre de questions et des reponses 
et leur categorie pour avoir une instruction programmee efficace (la conception et les 
programmes des legons). Nous esperons eyentuellement nous servir des "protocols" 
comme base de developpement d* algorithmes permettant de poser des probl^mes et de les 
resoudre. 

Le laboratoire fonctionne depuis decembre 1971 et les legons se font sur 
les aspects de 1* anglais comme deuxi^me langue et sur certains points du cours concernant 
1* aspect humain des sciences S la SGWU. (Les premiers resultats sur la valeur des 
programmes seront donnes si nous en disposons). 
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A LABORATORY FOR CYBERNETIC LESSON DEVELOPMENT 



Gary Boyd, Sir George Williams Universi 
April, 1972 



1 

One difficulty which arises when one attempts to introduce 
machine-based (CAI, teaching machine, PI) study materials into 
an existing educational institution is the difficulty of obtaining 
or producing instructional software which precisely suits the 
students' needs and the established curriculum of the institution* 
For the most part faculty are unable, or (given the limited regards 
available, undesirous, of producing theirllown programmes, and at 
the same time are very critical of materials produced elsewhere, 

A potential solution to this problem* is to produce study 
materials by transcribing and editing protocols obtained from 
person-to-person tutorials conducted by faculty with particularly 
needy, and with particularly deserving students. 

Recording, editing and transcribing audiotapes or videotapes 
of tutorials is a difficult and tedious process. However, editing 
computer files using a contemporary large time-sharing computer 
system with a good edit system is very easy - easier in fact than 
using scissors and paste if any appreciable amount of material is 
involved. 

One reason for setting up a computer-based tutorial recording 

This project is funded by a grant from the Direction Generale 
d' Enscignement Super ieur Quebec • 
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facility is to produce instructional programmes. A second reason 
for such a facility is to conduct research into the specific char- 
acteristics of programmes which enhance learning opportunities 
for particular types of students in particular subject areas. 

Theories of instructional design (and teaching algorithms) 
tend either to be so general (.e.g. "provide immediate reinforce- 
ment") as to provide little effective guidance to the lesson 
designer, or on the other hand tend to be so specific that they 
have to be newly formulated for each lesson. In the case of 
the latter, a system which facilitates such formulation and the 
requisite testing is to be desired. 

Given that recording and editing protocols may be a good 
way to produce validated lesson programmes and also may be a 
good way to develop teaching algorithms for specific classes of 
instructional problems, what sort of a facility is required? 

The simplest facility would be simply a divided room to 
cut off direct verbal and non-verbal interactions of the sort 
which are too complex to analyze (or to be incorporated into 
machine programmes). A slot in the wall would enable tutor and 
student to exchange written and dtawn messages. Such a system 
is perfectly possible, but would require a lot of tedious clerical 
work and would limit the forms of stimuli more narrowly than 
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available teaching machines or CAI systems. 

Instead of a slot in the wall, if we give the student and 

the tutor each a computer terminal on a system wuch that both can 

communicate directly, then automatic transcription, timing and 
editing become possible. 

In order to handle visual and auditory messages, it would 
be desirable to have computer terminals capable of scanning 
images and carry out analogue-v.o-digital conversions and store 
all messages 'in computer files. At present the cost of such 
sophisticated terminals and of the vast memory that would be 
required outweigh the benefits. 

Audio-visual capability can be provided at reasonable cost 
by using closed circuit television as a link. A videotape recorder 
serves as an additional "memory", and by recording actual times 
from a digital clock on the videotape and in the computer files, 
it is possible to rapidly locate the segment of tape associated 
with any particular segment of computer-recorder dialogue. 

Moreover, by using computer terminals which provide alpha- 
numerice display in the form of a standard TV signal, it is 
possible to record the text along with the visuals on videotape 
and the whole facility can serve as an instructional TV production 
facility. 
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The general layout of the system is shown in Figure 1» 
Two-way communicaticn between student and tutor is confined to 
the computer terminal keyboard channel, while one-way visual 
and auditory communication from the tutor to the student is 
provided by CCTV and 2^n audio link. This constraint is necessary 
to enable initial editing and analysis to be carried out rapidly 
and easily using only the computer-stored data. It also corre- 
sponds to the limitations placed on student responses by most 
CAT systems and teaching machines which cannot accommodate freely 
structured verbal or graphic responses. 

This facility differs from an ordinary CAT facility mainly 
in the provision for direct on-line interaction between tutot and 
student, and also in the provision of a closed circuit television- 
link. 

The computer used to record and edit the protocols is a 
CDC 6400 computer with the KRONOS II time-sharing system. 

The tutorials are recorded using a programme called SCRIBE 
which open files as needed, and records each expression typed 
by either the student or the tutor together with stare, ad finish 
times and an indicator character (" for tutor; ^ for student) to 
indicate who typed in the statement. A sample print-out of a SCRIBE 
file is given in Figure 2. 
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It is necessary for the users to type delineating characters 
at the beginning and end of their statements, which SCRIBE uses 
to call the time, and which serve rather like tte expression 
"over-to-you" in a two-way radio conversation. 

Once the tutorial is recorded, the experimenter goes 
through the record and deletes irrelevant remarks (such as 
'•let's break for coffee now"). 

Then the tutor is asked to read through the file and 
identify errors and also to provide descriptive titles for 
, each topic and sub-topic covered. Several tutorials covering 
similar topics may then be merged into one file. 

The vetted file is then used as data for a programme 
called TRACON I, which converts the transcription into the format 
of a CAN CM lesson. Each line is given appropriate statement 
numbers and blank labels and the ''T** (text presentation) op 
code required by the CAN interpreter* A sample print-out of a 
TRACON output is shown in Figure 3* 

Further editing is then carried out to insert tables of con- 
tents or ''menus" of appropriate points, and the necessary CAN op 
codes to evoke proper branching. 

Another conversion programme, TRAMITS, will be used to con- 
vert files into instructional programmes for the MITSI teaching 
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machine. And the effectiveness of MITSI programmes produced in 
this manner will be compared with MITSI programmes written in 
the usual 'a-priori' fashion. 

The videotapes materials can readily be converted into 
slides and tapes for use in MITSI or with a CAI system. It is 
also possible to incorporate slide or movie film sequences into 
the tutorial if the tutor desires to do so. A rear projection 
syrtem feeds such materials up through the tutor's work surface 
to the TV camera so that he may point to details on the slides 
or films. 

The one-to-one relationship provides for complex inter- 
action but limits the number of students to be used as a test 
population. A response system and TV link to an adjacent class- 
room is planned to allow larger test populations, but it will 
greatly limit the complexity of resp'-nses and queries. 

I call this a"cybernetic" lesson-development laboratory becaus 
it incorporates the three basic cybernetic principles: 

1) use of feedback for goal attainment; 

2) acquisition of requisite variety for control; 

3) correlation of memories with respect to higher order 
invariants to achieve self-organization . 
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The provision of mutual feedback between student and tutor 
is obvious. The constraint imposed on the variety of message material 
to be introduced by the studer.t on the one hand and the wide variety 
of materials at the tutor's disposal on the other is only one side 
of the requisite variety management problem. The other side of the 
problem relates to choJLce of a variety of students with abilities 
and debilities characteristic of the total population of learners. 
This latter problem has only been tentatively solved by choice of 
some of the best and spme of the poorest students as participants 
for the tutorials, and more systematic sampling procedures will be 
developed in future. 

The "self-organization" is organization of study materials 
(CAI or MITSI) programmes which is carried out by comparing the 
topics covered and the questions asked in a number of tutorials 
and consolidating similar texts. The retention of "peculiar" 
(i.e. unique) questions and answers will be determined by the 
frequency with which subsequent students refer to them. 

The basic idea of the project is on th- one hand to provide 
a simple and straightforward way for regular college lecturers to 
participate in the development of validated tutorial material at 
modest cost, and on the other hand to provide readily analysable 
tutorial protocols for research purposes. 
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NEW KECOUn 



72/03/29. 10.58.4St 



TUTOR***** 10.59. 13. 

••VEKY GOOD* THEN* LILY. WHAT 
•♦SHALL WE 00 THIS MOKNING? 

TUTOR-v**** 1M.59.3W. 



:s?cr:c-.v v.- p ^ 



STUOEMT*** 1 I. 00.07. ■ 

•WELL* COULD YOU PLEASE EXPLL 
AIN TO ME ABOUT MEAilOLITHIC 
PALEOLITHIC AND ALL THE OTHER 



STUDENT*** 11.01.27. 



TUTOR***** 11.01.47. 

"FiKST OF ALL* WE MIST BE CEKTAIN 
Wf. KNOW THE DIFFIilRENCE BETWE- 
EN THOSE WORDS ,E>\M)ING IN 
... 'iiOIC* AND'mTHIC. 00 YOU 
♦•KNOW THE DIFFERENCE? 

TUTOR***** 11.02.43. 



STUDENT*** 11.03.00. 
•NO 

t 

STUDENT*** n.03.05. 

TUTOR***** 11.03.20. 

••THOSE WORDS ENDING IN 'ZOIC^ 
(IE. MESOZOIC* CENOZOIC*ETC> 
REFER TO GEO-BIOLCGICAL TIME 
PERIODS. EITHER TIME PER.IODS 
WHEN WE ARE DEALING WITH THE 
THEORY OF EVOLUTION 'BEFORE* 
MAN, OR WITH GEOLOGICAL 
EVOLUI lOiVCAGE OF EAKTH, ETC). 
IHOSK WOriUS ENDING IN 'ITHIC' 
REFER TO TIME PERIODS DEALING 
WITH THE CULTURAL DEVELOPMENT 
OF MAN. DOES THIS MAU<E SENSE? 
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TUTOR***** 11 .06. IS* 



FILMED FROM BEST AVAILABLE COPY 



kUY€ O 



fey TreAC^M . 



0LO«ST0RC8B 
READY. 



LNH 

M05 
0010 
0015 



00000000 
•0000000 
00000000 
00000000 
00000000 
00000000 
00000000 
00000i00 
00000000 



0030 
0035 
0040 
0045 
00Si 

Msis 

iM0 

00«5 00000100 T TUTOR***** I0*59«30« 
0070 

0075 



00000000 
00000000 



0085 
0090 

0095 
0100 
0105 
0110 

0115 
0120 
0185 
0130 
0135 
0140 
0145 
0150 
0155 
0U0 
0U5 
0170 
0175 
0180 
0105 
0190 
0195 



00000000 
00000000 
00000000 



00000000 
•0000000 
00000000 
•••9M00 



••000000 
00000000 



00000000 
00000000 
00000000 
00000000 
00000000 



0005 00000000 
0010 000000^^ 



*TCRNtllAT 



T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 
T 



********** 
NEW RECORD 
********** 



70/03/29. 10.S8.4S. 



TUTOR***** I0.59.13* 

-VERY 0000* TNEN« LILY. HKAT 
•*SNM4. WE DO THIS MORNINCT 



STUDENT*** 11.00.07. 

'HELL* COULD YOU PLEASE EXPLL 
AIM TO ME AMMJT NEAZOLITNIC 
PALEOLITHIC AND ALL THE OTHER 



STUDENT*** 11.01.e7* 



TUTOR***** 11.01.47. 

-FIRST OP ALL# ME HIST DE CERTAIN 
HE NHOH THE DIPPERENCE BETHE- 
EN THOSE HORDS ENDIN0 IN 
... 'ZOIC* AND 'ITHIC*. DO YOU 
**KNO0 THE - DIPPERENCE? * 

TUTOR***** 11.02.43. 



00000000 T STUDENT*** 11.03.00. 



*N0 



STUDANT 
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TliE CAI AC TIVITY QF THE DIVISION OF EDUCATIONAL RESEARCH SERVICES 
THE UNIVERSITY OF ALBERTA. EDMONTON 
By /Par: S, Hunka, 

University of Alberta. 
L'Universite de I'Alberta. 



SESSION 15 
ROOM/SALLE 148 



The Division of Educational Research Services has operated an IBM 1500 CAI 
system for the past four years. The activities of the system can be categorized into 
three major areas: a) demonstration, b) research, and c) production. 

The demonstration activities have involved a large number of lay and 
professional groups, teachers and students from local schools, and university staff 
and students. The research activity has been initiated from three sources: graduate 
students in various faculty departments, faculty staff, and the non-academic support 
staff for the system. Academic researchers have used the system more as a data collection 
device, while graduate students have used the system more in the study of computer 
assisted instruction. 

During the past year the system has been used for the teaching of reading to 
beginning deaf children of age five to six years, APL statistical laboratories. Course- 
writer programming to university students, and to provide an enrichment program to students 
in junior and senior high schools. It has been used to study problems in linguistics as 
well as in the measurement of intelligence through a simulation of the WISC. 

The largest continuous production type of course which has been operated now 
for two years is the medical series in cardiology. This series has been the most suc- 
cessful in terms of student learning and attitudes. A second project has now been 
funded for the development of programs to simulate medical patients and some work has 
already been started in this area. 

More recently a new research area has been opened by the funding through 
Canada Couocil of an oculometer project. This project is. concerned with developing the 
hardware interface necessary to have a small mini-computer monitor the video output of 
a Honeywell video oculometer, and to calculate pupillary dilation and the target being 
observed by the eye. The development is directed towards the study of eye movement and 
pupil dilation while a student interacts with the CAI computer. 

TRAVAUX EAO DE LA DIVISI ON DES SERVICES DE RECHERCHES PEDAGOGIOUE S 
UNIVERSITE DE L'ALBERTA> EDMONTON ^ 

PAO Tpu ,c;nJf ^^V'^^'''} services de recherches pedagogiques a utilise un syst^me 
EAO IBM 1500 pendant les quatre demi^res annees. Ses travaux peuvent etre repartis en 
trois domaines principaux: a) la demonstration, b) la recherche et c) la production. 

^ De nombreux groupes de profanes et de professionncls , des professeurs et 

des etudiants des ecoles locales et du personnel et des etudiahts de I'universite ont 
pris part aux travaux de demonstration. Les recherches ont ete lancees par: les 
etudiants diplomes des divers departements de la faculty, le personnel de la faculte 
et le personnel^de soutien "non-academique". Des chercheurs "academiques" ont utilise 
le systSne plutot conme dispositif pour rassembler des donnees tandis que les Etudiants 
diplomer. 1 or.^ utilise plutot pour etudier I'enseignement ti I'aide d'ordinateurs. 
co^.He 5 So ^^""^^ ^^n^an, le syst&me est utilise pour enseigner la lecture aux debutants 
sourds ages de cmq a six ans, dans les laboratoires de statistiques APL, pour la 
programination Coursewriter" pour les etudiants univcrsitaires et pour etablir un 

enrichissement pour les etudiants des cedes secondaires. II a servi 5 
"iS^! P^^^l^"^^^ de linguistique et aussi 1 mesurer ^intelligence par une simulation 

^ J .5.^^ ^'^^^ ^^^^^ P^^^^ ^ reproduction en serie pendant les 

deux derni^res annees est celui de cardiologic. C'est la serie qui a eu le plus de 
Wo«c Z'' consid^re I'attitude des etudiants et leurs possibilites d'apprendrr.. 

nonr T'^Lt^l i f'"'' ^'^^^^^ "''^ ^^"^^^"^^ ^'"^^ developpera des programmes 
pour simuler des malades et on a commence les travaux dans ce domaine. 

Recemment, des fonds donnes par le Conseil du Canada ont permis d'entreprendre 
au 'oint 1 if J' I'ocuWtre. Cette etude a pour but de met^re 

Hnir ^« ifii T entre un ordinateur miniaturise et I'oculom^tre Honeywell qu'il 
doit surveiller et aussi de calculer la dilatation des pupilles et la cible observec 
par I'oeil. Ce travail a pour but d' examiner quels sont les mouvements de I'oeil et 
la dilatation des pupilles lorsqu'un ctudiant travaille avec 1' ordinateur EAO. 



ERIC 
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THE CAI ACTIVITY OF THE DIVISION OF EDUCATIONAL RESEARCH SERVICES 



S. Hunka 
University of Alberta 

The comp^tter-assisted instruction facility at the University of Alberta 
has been in operation for about four years. During this time much has been 
learned about not only the technical aspects of CAI but also about the political 
and human factors which are involved. 

The hardware configuration which we have is the IBM 1500 System. It was the 
first to be delivered outside of the United States, with the second one delivered 
to the Department of Education in Quebec. The system is basically driven with 
an IBM 1130 computer having 32K words of core, 1 system disk, and 4 additional 
disks for storage of course material. At the time of delivery only 8 terminals were 
available 2 of which were typewriters. A terminal is configured as a crt capable 
of holding 640 characters with half lines and column coordinates being addressable. 
The basic character is configured as a dot matrix of 8 dots wide and 12 dots high. 
Each terminal also contains a light pen, an image projelftor, and an audio play/ 
record unit. About two years ago 8 additional terminals were delivered and a 
magnetic tape unit to permit transfer of material to the University's IBM 360/67 
computer was obtained. For the past two years the amount of equipment has remained 
constant. 

« 

The software received with the delivery of the system consisted of Coursewriter 
II and MAT, the latter being a subset of APL. To the equipment and software we 
added three people: a manager, one programmer, and one operator, and an awful lot 
of faith. At that time the costs were $96,000 for rental of all the hardware and 
$16,000 for support personnel. The current costs are about $143,000 for rental of 
all hardware which includes 19 terminals, and about $55,000 for direct support of 
staff which include three operators, one system programmer, one Coursewriter programmer 
and a manager. By commercial standards where personnel costs are taken to be 
roughly equal to hardware costs, we have much to be desired. 



Delivered at the Canadian Symposium on Instructional Technology, Universitv of 
Calgary, May 26, 1972 
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During the four years we have had the facility, no work to speak of has been 
done to actually improve the hardware capability of the system. Therefore, as 
far as this part of our work is concerned we have contributed nothing to the 
development of improved terminals or cpu hardware. 

Contributions have been made to the Improvement of software for the system. 
Perhaps most CAIauthors are familiar with Coursewriter II, but only as it appears 
in regular IBM manuals. Although the basic operation codes are documented in 
such sources, the power of Coursewriter irests in its educational system support 
function and in assembler code functions which have been developed by ourselves and 
other 1500 installations. .These functions were written because Coursewriter II 
did not provide the ^type of programming power required by programmers with,^yen modest 
training. Many of the functions arc directly related to problems involved in 
answer analysis and involve such operations as identification of keywords, keyletters, 
message sycthesis. numerical limit functions, and so on. 

More recently some Important developments have been made in the construction 
and use of graphics or drawings which are displayed to the student on the crt. 
Initially, graphic units equal to the size of 3 characters high by 2 characters 
wide had to be constructed by punching each dot '.light as a hole in a card. 
Recently, and within the context of Coursewriter II we have the capability of 
constructing graphics directly on line and visually observing what the graphic will 
look like when it is presented to the student. Authors may now use the light pen 
and construct drawings on their screens, concatenate drawings from one authors set 
to anothers, rotate drawings around a horizontal or vertical axis, copy portions of 
one drawing to another, and re-position them on the screen. Near completion is a 
second facility which will allow the writing onto the crt screen of character 
strings magnified by a numerical factor specified as a parameter by an author. In 
the past we have had to spend inordinate amounts of time to have larger than 
normal sized characters available for young pre-school children. 

Some changes have also been made to the operating facilities of the Cour^sewriter 
system. Different scheduling algorithms have been constructed to Improve response 
time, and because of the inability to provide operators during the weekends 
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and very late evenings, certain commands normally only available to operators have 
been made available to graduate student authors. 

Although not directly connected with the 1500 system, we did develop a new 
authoring language which was a pre-compiler to Coursewriter II. This language 
attempted to separate instructional logics from subject matter in the same manner that 
in . numerical programming one keeps the numerical logic such. as in a Fortran 
source program, independent of the data, with the return of Dr. Romaniuk to our 
group, we hope that we will be reviewing this procedure. The availability of 
a large scientific computer, such as the 360/67 has been invaluable since the work 
of VAULT could not have been done on a small machine, nor could have a number 
of special programs for documenting Coursewriter II programs been written. All 
listings of code and documenting the technical aspects of programs is now accomplished 
through magnetic tape transfer of Coursewriter code to the larger university computer. 

The operation of the 1500 system has been directed towards the attainment of 
three objectives: demonstration, research, and production. During the past 
four years there has been no problem in meeting the demonstration objectives since 
almost any CAI system with crts and some simple demonstration material can be made 
of interest to a wide range of people. Most frequent visitors to our installation 
have been teachers and their pupils. During the past four years there have been 
about 2000 public school pupils and their teachers visit the installation. Within 
the University itself we have had conducted demonstrations for about one quarter of 
the faculties, with the majority of demonstrations being conducted for students 
and their instructors in the Faculty of Education. Conducted demonstrations are also 
given to professional lay groups from the community and to instructors and students 
from other post secondary institutions. We have been very fortunate in that visitors 
have been very cooperative in the use of the system and no damage has resulted. 

In the research area it is more difficult to describe in a meaningful manner 
what has been accomplished. In an academic institution one'\s tempted to cite 
the number of publications or theses which have been written. The Division has 
not been a prolific distributor of CAI publications because there have not been 
enough staff available to do this work, while other professors in the Faculty 
who have competence in CAI are sufficiently loaded not to have time to contribute 
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to our work in this manner. A second factor is that the Division is not a teaching 
unit within the Faculty, and thus theses completed in the CAI area are the 
responsibility of the teaching de;^artments. The departments most directly involved 
are Educational Psychology and Secondary education. In the former the systan has 
been used primarily as a data collecting device for studies of learning, concept 
formation, visual search strategies, and more recently in simulations. In the 
other departments, concentration is directed more towards the study of instructional 
paradigms, with more attention being given recently to aptitude treatment inter- 
action. In general, results have indicated that CAI is effective and a time saver. 
In most cases the programs constructed have not been optimized in the sense that 
they have been well tested and improved before an experiment has begun. This I 
suspect is too characteristic of CAI studies and is a factor which is generally not 
reported with the experimental results. In the most recent study completed by 
J. Isaacs, the CAI system programmed to teach logarithms using two instructional 
methods was compared with a controlled presentation within a classroom. Although 
CAI produced superior results relative to the classroom treatment, the program was 
one which was tested by getting other graduate students to 'try it out'. 

There are major problems which have to be overcome before more research in the 
CAI area will become characteristic in universities. Academic staff members 
are generally sufficiently naive about computers that the CAI system is treated 
in the same manner as any other scientific number cruncher. There are few academics 
who are interested in trying to investigate the complex parameters involved in 
actual teaching. They appear more interested in more 'basic research' which from 
an instructional point of view, is frequently less relatable to CAI. In other 
words, we have few researchers who are willing and interested, and who have the 
resources to study instruction as an end in itself. Not an unimportant problem 
is that in our installation we have not been able to provide the kind of programming 
service which is required for a researcher not familiar with our authoring 
languages. The amount of time necessary to not only learn the authoring language, 
but then to program the material is sufficient to discourage most professors. 

The basic back-up services required to operate a CAI facility which encourages 
academic staff members to carry out.rerearch is considerably more than what we 
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anticipated in the beginning. Certainly the availability of grant funds are 
inportant, but probably not a sufficient condition. It is also necessary to have 
competent programing staff with members capable of communicating with academics. 
Taking teachers who have had one or two years of teaching experience and training 
them as specialized programmer for CAI seems to be an alternative if funds were 
available and particularly if there is a slight surplus of teachers on the current 
market. Further back-up resources are required for the preparation and integration 
of audio-visual, and special effects which are required by the authors. These 
services should not be scattered all over the campus requiring that the academic 
travel to several different technical service departments before he can get his 
work done. Further complications result when an author must do this laison work 
himself in that too frequently the technical producer does not fully understand the 
parameters which must be met in the production of the material. A second problem 
is that the producer of the audio-visual material does not see his product as it 
appears at the student's terminal. 

We have had a number of projects which have been labelled by some as production 
and by others as research. The difference is not as clear as some would like, 
although I wonder sometimes why a distinction is required. During the last couple 
of years we have been fortunate to have a dynamic Faculty of Medicine where not 
only are new curricula being introduced but also newer educational delivery systems. 
Our largest and most continuous application of the CAI system has been in the 
instruction of second year medical students. This project has been a good application 
in the sense that it was a live experiment with 'real' students who took the course ^ 
as a regular part of their medical curriculum. In addition, the subject matter 
author. Dr. R.E. Rossall, acted as a true author in the sense that he did no programming 
and in fact does not know Coursewxiter, but had his instructional methods and subject 
matter handled by a non-academic programmer. This course has been extremely well 
received by over 200 students in undergraduate medicine, as well as interns and 
general practitioners, the latter using it as part of a continuing medical education 
series. In general the attitudes towards this type of instruction have been very 
positive and academic competence has been estimated to be better than in previous 
year.« ,/hen the lecture method was used. Some work in this area of cardiology has 
spread to pharmacology with a small amount of material available on the system 
during the latter half of this last academic term. 
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Two other projects involving real students have also been carried out during 
the last couple of years. One project involves a course entitled Introduction to 
CAl which does involve the teaching of CAI programming. Last year ninety percent 
of the progranuning was placed on the CAl system with the result that the students 
were able to produce as much as 10 times more coding for their individual projects 
than the previous year. A second project involves the use of APL for statistical 
laboratories. We have less evidence on the effectiveness of this work because the 
courses are not under the control of our own staff. In general instructors of 
statistics are not interested in integrating their instruction with the laboratories 
being completed on the computer. Frequently lab assignments which were originally 
designed for use with a desk calculator are given to the student to carry out 
using APL". No attempt has been made to use the file capabilities of the system 
for storage of common data or programs; no attempt has been made to use the system 
to simulate numerical properties of stochastic functions. 1 think little can be done 
to encourage 'real' use of the CAl system unless the academic sees some meaningful 
payoff to him. At the moment there still is little incentive for academics to 
increase their instructional efficiency. 

During the last two years students who have worked closely with the Division 
have taken advantage of the Federal Opportunities for Youth summer employment 
program. Last year a student project was funded for the preparation of a program 
to teach the basic reading skills to deaf children who have just started grade one 
at the Alberta School for the Deaf. This project was funded for the s-m of._ 
approximately $8000 and was used to formulate and complete the basic coding of 
the subject matter and instructional strategies. An additional $3000 was spent on 
the project in terms of indirect expenses incurred by the Division. The program 
systematically introduces the student to the use of nouns, verbs, objects, and 
adjectives with automatic review based upon a defined criterial level of performance. 
The program depends heavily upon the use of picture presentations. The most complex 
level required the student to construct small phrases of 4-5 words based iipon his 
interpretation of a picture presented to him by the computer. Within the time 
period of about 8 weeks at roughly 1 hour per week, the children were able to 
discriminate over 100 words which they normally would learn during their full year 
in grade one. However, in checking their ability to match these words against the 
objects, there appeared to be little transfer. We have not investigated the 
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monitoring begins by the comput.>r through the use of Schmidt triggers which are 
adjusted to identify slight voltage changes which occur when the retina and the corneal 
reflect the infrared light. It is expected that the hardware interface will be 
completed by la:;?, this summer. One expected spin-off of the oculoraeter should 
be that a paraplegic could control our CAI system. 

What does the future hold for us? Much of our future rests with the future of 
universities in general. Because of the stringent budget problems which have been 
encountered for this yeav, the University is planning to purchase the IBM 1500 
system in order to reduce its operating budget. In this plan we hope to change 
our 1130 cpu for the fastest model which operates at 2.2 microseconds and to 
purchase disks which are 10 times faster thsn the current set of disks. Therefore, 
we shall remain in ths CAI area for at least the next five years. We are not sure 
what the future holds foe us in terms of support personnel uhich have always been 
required. Over the last four years we have had only one academic within the Division 
who was interested in CAI although there have been a large number of graduate 
students wishing guidance in this area. If further budget reductions are required 
in the year 1972-73, and with the purchase of the system about nintey percent of 
our funds will be for staff, further budget reductions would mean staff reductions. 
The current shortage of funds, coupled with the withdrawl of NRC block grants to 
computing centers has encouraged our computing center to institute a charging system. 
The charge of $1.50 per connect hour plus cpu time at $300 per hour is not going 
to encourage anyone to use the 360/67 as a CAI System. 

In terms of the growth of CAI In the province, much is resting on the report 
being prepared on thi- future of education by Dr. W. Worth. Govern..ient officials 
and ministers are holding back any najor decisions until it is released some time 
next month. This report will require careful study since some of the most 
Important decisions regarding the use of CAI will be made at a political level 
not at the academic level. 
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the psychological differences between the testing methodology employed by the 
school and that employed with the CAI system, A similarly sponsored program 
has been funded for this summer, but the subject matter is French. In this 
project an attempt will be made to develop a program for instruction in French 
for elementary and junior high school children. Further information may be 
obtained by writing Mr. Victor Muller, c/o of the Division of Educational 
Research Services. 

Two other projects have been in progress which involve students from local 
schools. One group of students from junior high schools in Edmonton have learned 
to program in Coursewriter and developing small programs to be used in their 
own classrooms. Another group of high school students are working entirely on 
their own using the system for APL work. Unfortunately, we were unable to find 
an academic to help them with their work. One thing we learned early in these 
two projects is that if one is not careful the students will take your system 
over. 

Our most recent and only venture into the area of hardware development is the 
oculometer project. This project was funded by Canada Council. Essentially we 
are attempting to develop an infrared oculometer which can be used for tracking 
eyemovements and to calculate pupil diameter. When operational this system should 
allow us to rapidly and accurately follow the eyemovements of children watching the 
crt screens of our CAI system. In this way we think we will be able to obtain a 
better method of evaluating screen displays and material being presented. 

The equipment consists of a standard PDP-8 DEC computer and a Honeywell 
oculometer, analogue to digital and digital to analogue converters, as well as 
magnetic tapes to store the volume of data which is expected. The video output 
of the television monitor is fed to a special hardware interface constructed by 
Professor Milton Petruk of our Division. This interface uses the horizontal pulse 
generated within the monitoring video camera as a triggering pulse to reset crystal 
clock counters used to determine the time necessary for the scanning beam to 
encounter the pupil and the corneal reflection, as we^Ll as to reset the line scan num- 
ber which is generated within the. camera. Software within the control computer is 
used to determine whether an odd or even line is being scanned since the video 
camera scans on an interlace pattern. Once all initialization has been completed 
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Everyone interested in education who has access to a computer is tempted 
to ask the wrong question, namely, "Given this particular computer facility, what can 
I do with it in education?" The answer is a trap: "Almost anything, but...". Tlie 
trap is that most educational uses springing from this naive interchange quickly exhaust 
both time and money, and typically lead to rigid systems of instruction that treat the 
student as a slave "for his own good". The original question was both too limited and 
too comprehensive; it now seems more productive to split this question into two parts. 
The heroic part starts at the computer end: "What is the optimum design fo-/ a comprehen- 
sive educational computer system?" In effect, all questions of design, cost, educational 
practice, and utilization are asked simultaneously. An example of the heroic effort is 
Project PLATO at the University of Illinois. The probability of success is not 
proportional to the size of the effort, and many such projects should be funded. The 
second part of the original question starts at the educational end and asks only the next 
question in sequence: "What technical or other aid is best for the particular learning 
problem (of cither style or content) faced by my students at this moment?" Usually 
the answer will not involve computers, but occasionally they will offer a brilliant 
solution, such as the wide use of an e^^sily-programmcd computer as calculator (Dartmouth 
and elsewhere), and the computer as animator of film loops that model physical svstems 
(MIT and elsewhere). Some ways of organizing courses allow piecemeal testing of " such 
technical aids. The combination of chipping away at the use of computers from the 
educational end and blasting from the computer systems end promises a good mix of short* 
term and long-term. payoffs. 

LES BONNES QUESTIONS A POSER SUR LES APPLICATIONS 
PES ORDINATEURS DAKS L'ENSEIGN£>iENf 

Tous ceux qui «• int€rcssent 1 I'fiducation et qui ont la possibilit6 d'utiliser 
les ordinateurs sont tentSs de poser une fausse question: "qu'est-ce que je peux faire 
avec cet ordinateur en pedagogie?". U r€ponse est un pi^ge: "presqua tout, mais..»". 
Le pi^ge reside dans le fait que la plupart des applications pgdagogiques resultant de 
cet ^change primitif epuisent tr^s vite In temps et 1' argent; genSralemcnc il m^ne 
a des syst^mes rigides d* instruction dont I'etudiant devient I'esclave "pour son propre 
bien . U question pos€e I I'origine 6tait H la fois trop restreint^a et trop vaste; il 
nous parait maintenant que, si on divise la question en deux, le rendement sera meilleur. 
La partie hirofque commence ^ 1 •ordinateur: "quelle est la meilleure conception 
pour avoir un syst^me global p€dagogiquc 2i I'aide d'ordinateurs?". En effet, touteji les 
questions de conception, de prix de revient, d'habitudes pCdagogiques et utilisation 
sont poshes en mSme .temps. Un des exemples 3e I'effort "hcrolque" est le projet "PLATO", 
^^l*Universit6 de I'lllinois. U probabllite de succ^s n'est pas proportionnelle a 
1 effort ct beaucoup de ces programmes devraient ctre subventionnes. La douxi^me partie 
de la question d'originese situe dans la partie Educative et ne pose que la question 
sulvantc dans 1 ordre: "quel est le meilleur moyen. technique ou autre, pour resoudre 
le problJ^mc particulier (probl^me de style ou de contcnu) auquel mes TslJives font face 
en ce moment? . C^n^ralement, Ja rSponse n'implique pas 1 'utij isatlon des ordinateurs 
mals de temps en temps, ceux-cl peuvent offrir une solution briUante, par exemple, 
1 utilisation fitendue d un ordinateur, facilement programrro, comme calculateur (a 
Dartmouth et ailleurs) et comme anlmateur de films en bouclos representant des; systZ^rces 
sous forme de modules (3X M.l.T. et ailleurs). Certaines methodes d'organisation des 
cours permQttent d essayer, partie par partie, ces moyens techniques. Si les pedagogues 
se servant d ordinateurs et acceptant de faire des observations constructives, travaillent 
en collaboration etroite ave': des ingCnieurs soucieux de perfectionner les ordinateurs, 
on dcvrait arriver 21 des solutions avantageuses, a court terme et d long terroe. 
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TWO WRONG QUESTIONS 

TWO great traps in the instructional applications of 
the computer are localism and empire building. Localism 

seeks an apparent economy: to use whatever comouter 

facility is locally available to do something useful in 
education. Tt fails to recognize that the rigidities of 
all but a few of the most expensive standard computers 
reader them wholly inadequate to the subtleties of in- 
fu Emgire building looks to organization to bring 

the benefits of computer assisted instruction to large 
numbers of students. It fails to recognize that there iG 
as yet no agreed-upon benefit of CAI that can be conveyed 
to large numbers at reasonable cost. Ours is the age of 
the pioneer; the age of the entrepreneur is just dawning. 
We look more closely at these two traps. 

Localism asks the question: Given this particular 
computer facility, what can I do wiWTt"liredu cation? 
(the first wrong questionfT O^ii^ answeiri~a""tri[Fl 

Almost anything, but " when powerful facilities 

are available, the "almost anything" part of this answer 
IS impressive. At MIT we once set up a "conversational" 
system that carried on (via typewriter) a coherent dialogue 
on several subjects from physics to poetry with never an 
embarrassment or; loss for words. 1 i have heard proposed 
a system in which an extensive structural model of 

reality in some field is compared with a continuously 
updated model of a student's understanding of this field, 
the computer ranging over both structures probing and 
improving the student's understanding with questions and 
instructions assembled from the data bases. Interactions 
with graphic displays can be delightful and powerful guides 
to intuition, particularly displays developed at techni- 
cally sophisticated installations such as the Livermore 
Laboratory in California. 

The "but ..." part of the answer ("Almost anything, 

aut ) is equally i.'t5>ressivv'i. our conversational 

dialogue system cost fourteen dollars per hour terminal 
time plus processor and file space, took one man-year to 
systems-program and one man-year to apply to a dialogue 
that occupied less than one week of a student's time. 
The reality model" tutorial would require much more 
programming an^* a half-million words of dedicated 
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memory. The Livermore interactive display projects exist 
as Sideshows m an immense military development center. 

Facilities available to most of us (particularly, in 
the U.S.A., since fxmds dried up) constitute a restricted 
> temptation to localism. , One classic quandry concerning 
limited facilities is whether to spend small resources 
developing a new and better coitputer language or to use 
whatever language is available in order to get on with 
the job of education. Alfred Bork and Richard Ballard 
describe the usual results: 2 

These developments have tended toward one 
of two fates. Firstly, those producing new 
languages have often exhausted their resources 
and energies short of producing sufficient 
teaching materials to establish convincingly 
the merit of their approach. Those seeking 
to produce complete courses of computer- 
assisted material have tended to accept the 
language imposed limitations, opting for 
siir5)le multiple-choice, limited response, 
and numerical branching structures, in order 
to achieve the necessary volume. The re- 
sulting programs only occasionally exhibit 
educational strategies or facilities distinct 
from those found in conventional or pro- 
grammed instruction. 

Similar fates await most of those who design terminals or 
devise communications systems for education. It is usually 
unproductive to nibble away piecemeal at the separate tech- 
nical innovaUons that must be orchestrated in a successful 
educational application of computers. 

Eitpire building asks the question: How can we 
organize to apply existing techniques on a Targe icale? 
(the second wrong question) . A look arouHd quickl5~^oses 
existing techniques" to be perplexingly many and varied. 
Moreover, we wish to escape localism and are cautioned by 
those who administer and fund our work to make use of the 
most effective system available. So we fall into a 
further trap: we take a survey. MIT receives numberless 
requests to fill out forms describing our educational 
coitputer work. These forms end up in the wastebasket 
because (1) they typically force all descriptions into 
a single mold to allow classification, thus suppressing 
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uniqueness, (2) developments are so rapid that most pr 
jects are transformed or discontinued before survey re 
suits are published, (3) in a published document one 
cannot be candid about failures, and (4) almost (but 
n6t quite) all education experiments that do not fail 
outright yield no significant difference when compared 
with conventional instruction. ("In the dark all in- 
novations are beautiful"). Leave surveys to the oro- 
fessionals; Karl Zinn is at this conference. 



TWO RIGHT QUESTIONS 

We need to carry out investigations in instructional 
uses of the computer that have some chance of proving 
useful in the long run while avoiding localism and empire 
building. I believe we have seen enough failures and 
potential successes to recognize at least two fruitful 
styles for such investigations. The description of these 
styles wxll sound strangely like localism a:ad empire 
building and indeed are tne "good sides" of these two ^ 
perversions. 



I believe that at the present epoch the problems 
posed by instructional uses of computers must be chopped 
firmly into two parts. The heroic part starts at the 
computer end: What is the optimum design for a compre- 
hensive educational confute r system ? In effect, "all — 
questions of design, cost, utilization, and educational 
practice are asked simultaneously and from the beginning. 
We need the Henry Fords of automated instruction. Henry 
Ford is credited with applying the assembly line to 
automobile manufacture, but his accomplishments also 
encompassed invention, development, organization, finances, 
merchandising, labor relations, and (abortively) inter- 
national politics. He did not, of course, take any 
responsibility for the ultimate problems of public 
policy posed in our day by wide use of .the automobile; 
he could no more predict these problems than we are 
able to envision the ultimate consequences of computer 
use in education. But he did become entrepreneur and, 
yes, empire builder by virtue of his willingness to 
engage simultaneously all questions about establishing 
the automobile on the roadways of the world. 

Please understand: answering the heroic question 
about an educational computer system does not require 
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spending a lot of money, at least initially. Proiect 
PLATO at the University of Illinois expects someday soon 
to install 4000 terminals around the state and into 
Canada. This is a heroic effort with, I believe, a 
strong promise of success. Yet for most of the years 
of Its existence, until 1967, the project had no more 
than four full time equivalent employees and an annual 
budget of $150,000 or less (plus. donated computer hard- 
ware). ^ 



A second fruitful approach to the instructional use 
of computers starts at the education end and asks only 
the next question in sequence: What technical aid or 
wai 9l organizing learnincy is most effective forlnv — 
^^"^11 scale) educational problem ? The f ocus-^fl^tten- 
tion IS the educational need and not a pre-existing 
computer facility. Indeed, most often the answer to 
the educational question will not involve computers, but 
sometimes they will offer a brilliant solution. The " 
question implies a running knowledge of educational 
innovations (computer-based and other)— but not from 
indiscriminate surveys! One needs to monitor the litera- 
ture and to obtain good advice on a personal basis from 
those with taste, style, and discrimination in educa- 
tional change. 

Whereas the heroic effort to design an entire 
system can be likened to a full scale invasion into 
enemy territory, the educational question is a guerilla 
attack or commando raid. Two such commando raids that 
have been very successful for us are the generation of 
film loops and the use of the computer as computer. We 
have used computers to animate films that model physical 
results m realms that are far from everyday experience."^ 
For example, m physics the subjects of relativity and 
quantum physics deal respectively with the very fast and 
the very small, both of which regions are described well 
by mathematical laws that are very hard to understand 
intuitively. A display that models the results of these 
laws with appropriate scaling constitutes a kind of 
demonstration that can focus and summarize understanding 
while eliciting and directing questions. Notice several 
features of producing film loops that make such projects 
truitful: (1) One does not mind spending money once in 
order to produce the master print that can then be~re- 
produced inexpensively. Various commercial and academic 
centers offer technical facilities and staff to program. 
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display, and film these sequences. (2) Dissemination is 
simple and relatively inexpensive by means of film loops 
or regular 16 ram film. (3) We have found that the loops 
are so rich m physical insight that film titles cannot 
possibly explain all features of the display. In conse- 
quence we have begun to produce study booklets and other 
aids that can accompany and interpret these loops. 
(4) Planning, programming, and producing a film loop 
makes an excellent student project. The student under- 
taking such a project must master the professional con- 
tent of the film as well as the technical aspects of 
execution and the educational uses of the result— all 
withm the context of a limited and specific goal. 

Another successful small scale educational use we 
have made of computers is as computing slaves for students 
student exercises in science and engineering have too 
often provided a limited experience with over-simplified 
special cases in order to make it possible for the student 
to carry out calculations himself. With access to a 
computer he can undertake very much more difficult 
problems and explore them much more widely by varying 
parameters and his method of attack. Along the way the 
student encounters this delightfully ironic twist: he 
must formulate with precision what he wants the computer 
to do and the computer executes his instructions literally 
what better way is there to learn than to become the 
teacher of a facile-but-stupid machine? in using the 
computer this way on an occasional basis, we have some- 
times found It economical to hire commercial time-shared 
BASIC systems rather than using the more expensive MIT 
computing facilities that are unnecessarily powerful for 
our purpose. Dartmouth College has been in the forefront 
of this effort, solving simultaneously the problems of 
computer language, hardware and software, integration 
into educational practice, communication, funding, and 
dissemination on its own campus and to nearby campuses 
and high schools, thus elevating the enterprise to the 
level of a heroic effort. 

Some innovative methods of organizing a course can 
provide a setting for the piecemeal application of small 
educational experiments. For example, we have made con- 
siderable use of the so-called Keller Plan (sometimes 
called self-paced study or the personalized system of 
instruction) according to which each student can progress 
at his own rate through self-study materials with a lot 
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of personal help from student tutors and tests of mastery 
at each step in his progress. 4,5 rphe Keller Plan is not 
primarily computer-based, but we have taken one or more 
units of study in such a course to try out film loops and 
the use of computer as computer (as well as such non- 
computer aids as take-home experiment kits, demonstra- 
tion experiments, and programmed supplements). Since 
students pass through a particular study unit at different 
times. It is possible to revise the material continuously 
in the light of experience or to replace it entirely if it 
fails with the first students who reach it. Thus self- 
paced study provides a fertile test bed for many small 
educational innovations including computer aids. 

Chopping the computer-education business apart into 
the heroic enterprise and the careful appropriate use of 
partly-proven techniques helps us to see where our indi- 
vidual efforts can be of the most use. It leads to the 
really deep question, "Who are you? " If the answer is, 
for example, "educator and physiSTst" then the oracle 
will have no difficulty in advising us: "Then educate 
in physics by whatever means are at hand . . . leave the 
Henry Ford projects to others." 

A SMATTERING OP OTHER QUESTIONS 

Here is a random list of additional questions 
assembled in the process of composing this paper. These 
questions were all asked and answered, implicitly or ex- 
plicitly, for every one of our successful uses of com- 
puters, and should have been asked but were not in all 
of our failures. m the Appendix is a further list of 
questions published previously to accompany an analysis 
of the failure of a computer interactive display. ^ 

WHO will tell you that you are crazy? Someone will 
always volunteer this opinion, but it is important to 
solicit advice from the right hard-nosed commentator. 
Professor Victor Weisskopf , a world figure in physics, 
was shown the conversational tutorial system described 
above when it was still being developed. In less than 
two minutes he recognized that the analysis of student 
conceptual errors was better handled by other humans 
than by machines, and said so clearly and forcefully. We 
finally came around to his point of view only after ex- 
pending many further man-hours and foundation dollars on 
the project. 
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Can students vote with their feet? A very effective 
evaluation method is to prescribe as concretely as 
possible what you expect a student to be able to do and 
then to give him a computer aid as one of .several alter- 
native tools for developing the required skill. Our edu- 
cational system carefully trains students to find the 
most efficient path to a prescribed goal^ so their choice 
of a computer program will be an honest vote in its 
favor. 

DQ^s the program ask computers to be people? Although I 
know of no theoretical limxt to the computer's ability 
to mimic human intellectual processes r there reamins a 
world of difference between a CDC 6600 at $500 per hour 
and an undergraduate tutor at $2 per hour. In our ex- 
perience the undergraduate is far and away more capable 
of identifying difficulties a student is having than the 
presently most sophisticated computer program. Taste ^ 
judgment and analyzing errors are, for the present, 
better left to people. ^ 

Do^s the program ask people to be computers ? Here one 
all too often recognizes the 3M Distemper: memorization, 
manipulation, and multiple choice. Each of these may have 
their place at some stage of education, but almost without 
exception they are mor6 efficiently carried out through 
more established technologies. 

Who is the master? The crucial question toward which our 
line of thought has been leading. We abandoned our con- 
versational computer tutorial program, in part, because 
at any stage of a dialogue the computer had to be able to 
identify the context. The best way to do this was to 
have the computer ask questions; and it was our final 
judgment that a computer has no business bossing students 
around. The Dartmouth BASIC system, available to all 
students, is educationally productive in direct propor- 
tion to its powerful and facile slavishness. 

How will )rou recognize a failure? Education experiments 
have a way of succeeding by definition, whereas in fact 
one success in five experiments is as good an average in 
education as it is in the laboratory. John Archibald 
Wheeler defines genius as the ability to make all possible 
mistakes in the shortest possible time. With excellent 
advice and continuous thought, you may be able to try one 
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promising idea after another so rapidly that successes 
come more often than your colleagues can recognize the 
failures. That is called research. But should you get 
locked into an expensive and unproductive enterprise, 
bury It as quickly as possible. Then, after the shock 
has worn off, let the learning juices flow around the 
experience. Together with what you learn from success. 
It may qualify you to give invited papers at conferences 
m beautiful surroundings far from home. 

APPENDIX 

QUESTIONS TO ASK ABOUT A PROPOSED TECHNICAL LEARNING AID^ 

We list some questions one might ask about a proposed 
technical system that is designed to fulfill or assist in 
fulfilling some educational purpose. The list does not 
include (and should be added to) questions about the pro- 
fessional correctness of the materials, the strategy of 
their presentation, the resources necessary to develop 
the tool, the competence of those making the proposal, 
long-term effects on the curriculum, and the human effects 
of the resulting innovations. 

1. Does this device truly teach anything ? 

2. What does it teach? 

3. How well does it teach compared with already- 
existing methods or simpler alternative methods that might 
be developed? ^ 

^x,- i' ."^Y® students been involved in the planning for 
this device? 

5. Have preliminary or mock-up versions been tried 
with stuaents? 

6. How do students respond? 

7. How much ot-his own money would a student be 
willing to spend to use the device for one hour? (Ask 
nimi ; 

8. Are local faculty who might use the device 
participating in its design and execution? 

9. Is it based on an established technology, 
defined as one for which professional commercial trouble- 
shooting and repair is quickly available locally? 
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10. If maintenance and repair are to be provided by 
the school, what is the average annual salary of the staff 
person needed for this purpose, including fringe .benefits? 

11. Can an adaptation of the tool to a more estab- 
lished technology allow much wider dissemination with 
only slight sacrifice of its central education features? 

12. Can the new tool be used in courses as presently 
run? If it is successful, in what direction will it in- 
fluence the development of these courses? 

13. What publicity is required to encourage full use 
of the device? 

14. How many students can use the services of this 
device simultaneously? 

15. How many hours will each student use the device 
m the course of learning what it has to teach? 

16. What is the cost per student hour, including 
overhead? 

17. What is the marginal cost if one student uses the 
facility for one additional hour? 

18. What is the additional capital cost, above present 
investment, to provide the service to a class of 10 stu- 
dents? 100 students? 1000 students? 

19. If a school 100 miles away wants to install this 
system, what will be required in professional advice, in 
staff at the new location, in capital investment, in 
running costs per student hour, and in maintenance and 
repair? 
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It is an almost impossible job to sum up this conference, 
I thought so before I came to this last session but, after listening 
to Dr* Taylor, I am quite sure* I am going to offer you some • 
comments in the hope that you can use them as a stimulus. Before I 
start, however, I want to mention that the Associate Committee 
which organized this conference with the assistance of the University 
of Calgary is doing two things about publication: one is to publish 
the "Proceedings". The other is that the Associate Conroittee 
approved the idea of publishing selected items from the Proceedings 
in the International Journal of Man Machine Studies. I shall be 
editing this and I request either that I write to some of you to 
invite submission of lengthened versions of your papers, or that 
you send in papers to me as quickly as possible. For Dr. Hunka 
I might remark that this is a good way of accumulating a few 
"Brownie points", I was looking hastily at the notes for authors 
in the back of the J.M.M.S. and noticed that there is no page charge 
and that you get fifty free reprints. So this is an even better 
investment for the future. A further comment on Hunka' s remark is 
that the notion of making page charges seems to be an entirely 
American idea. I never publish in journals that make a charge, there 
are plenty of journals that will pay you, and in this way you can 
get two lots of Brownie points, a little investigation will show 
authors which Journals are involved. I start by making two remarks 
on Dr. Taylor's powerful address, they are in a sense anecdotal. 
The first is in connection with his observation that the students 
uF-e of the computer gives an honest assessment of its worth. I 
would like to challenge this. I give, a fourth year class on 
Mathematics for Engineers. One of the things that the students 
imagine from my background is that this class is one which involves 
the use of the computer. I point out to them that any example set 
may or may not involve the use of a computer and that if they use a 
computer on an example which does not involve computer use they will 
be penalized, not only for that example but for the whole course. I 
regret to say that, in the last batch, which is fairly typical, 
the whole group of 43 students all used computers on all of the 
problems. None of the problems were supposed to be done this way at 
alll So I am not in the least bit sure that use of the computer 
indicates anything at all except, perhaps, student stupidity. I have 
got another suggestion for Dr. Taylor, as he invited instant comment. 
This concerns what he does with his children on a Saturday morning 
to stop them looking at the T.V. cartoons. I have a very easy 
solution to that which I in fact use: don't have a T.V. set. 

Now let us get to more serious matters. One comment I 
heard at the beginning of this set of meetings, was to the effect 
that some people were disappointed that there was no oxtensive 
presentation of the latest goodies in AV-T.V* I disagree, these are 
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state of the art items which you can see all about you, particularly 
in this well endowed university which has everything from closed 
to projection T.V., things which are not often found in schools. 
It is particularly nice to be able to complement the University of 
Ca.Tgary on this, in view of Dr. Hunka's remarks on the poor 
financial state of Alberta. This leads rather naturally to the 
conment that Dr. Taylor made on the piecemeal approach to the 
solution of problems versus the apparently well thought of heroic 
approach of looking at the problem as a whole. I think this is 
worth singling out for special comment and I would like to commend 
to you the following. In Canada most of us do not have the funds 
that MIT have, even in their present state of "financial distress". 
Thus we cannot engage in heroic experiments. I think that much can 
be done by devoting some time to thought before starting on 
experiment. Such thought may define the system so that limited 
experiments can improve certain parts of it. An example of this 
comes from MIT. Ther*-. is a problem which, in Engineering Faculties 
in Canada, is usually called the "MIT problem". It can be thrown 
at students at any age group. Hand them, for example, a brick and 
ask them to write down things for which it can be used. Usually 
you get 8 or 9 examples drawn from building practice. I have 
modified this slightly and give them a telephone relay or some 
bit of electronic junk and ask them what can be done with it. Of 
course the maximal marks go to the student who says you can take 
the wire out and use it to hang the professor for asking a 
question of this sort. But this idea of convergenc and divergent 
thinking, I think is at the root of Dr. Taylor's remarks. 

Turning now to the papers which were presented at the 
meetings, I notice one significant thing. This is che very small 
amount of hard data which were presented. A number of people 
gave us overall plans for grandiose schemes which they have 
suggested but have not tried. Thir, is fine as long as the schemes 
are going to be subject to critical appraisal, presumably by a 
respectable peer group, before they are tried. But I can see, 
for example, some of the do-gooding international organizations 
wasting a great deal of do gooding international money implementing 
schemes which, even at a first look from outside, appear to have 
numerous holes in them. It would be nice to have a large amount 
of experience of small systems before indulging in very large ones 
with the dubious possibility of getting any results. My own view 
IS that the final judgement on CAI will be made on the basis of 
cost effectiveness. If it costs 25 cents to process one student 
by conventional methods and costs $25 to do the same thing by 
computer then it is most unlikely that anybody is going, in the 
present state of world finance, to put you up the $25. It is nice 
to do experiments on a limited scale but don't really go away with 
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the rosey-eyed opinion that people are going to put up $25 a time 
for running these systems in schools. You have in fact to show 
that some cost benefit which can arise from introducing a CAI 
system. 

This leads naturally to another example of what I 

Zriltlt f° ^ ''^^^ ^"'^ * ^y^'*"- " been mentioned 
periplieraly in a number of papers two of which I have heard this 

morning: Dr. Taylor's paper and another on the computer education 
? ^Mn^ Both authors made the same general point, although 

I think without singling it out for the specific comment that it 

flas^noA ^" important simply because it makes 

classroom instruction cheaper. I concede the point that the 
computer is inferior to a human being in almost every way except 
perhaps as a number cruncher. And even then, those of us who 
have known people like the late A.C. Aitken, a very well known 
Scottish mathematician and classical scholar and also an 
arithmetical prodigy, may have some doubts about the arithmetical 
superiority of computers over the human brain. The point is made 
by the following story about Aitken. In the 1950' s, when I was 
chairman of the British Computer Society; we invited Aitken to cive 
ThL Sr^r^K? arithmetical J^^rs. It so happened Sit 

I had recently obtained from the U.S.A. a printout of the latest 
computation of pi to 10,000 decimal places. I meTitioned this to 
Aitken when we entertained him to lunch and he said. "Oh well I 
want to rest this aftamoon, I always rest before these performances 

iriitrM"'%'^i'"' '"'^ printout?" I agreed and hH^r 
it with him. In the eveni^ig, after he had given one of his 

SvZ ^K 'ii^Pl^yf of multiplying 10 digit numbers together and 
l ltlLtt t^neously, probably slightly better than 

a computer could have done at that time because of input - output. 

and that he had brought the sheets with him. He said that he 
would give an example of a thing that a human being could do 
without being programmed. He handed the sheet to somebody in the 

f5 Soo'Z??' ^"^"^^.'^i" '° 5 digits anywhere in ?he 

10.000 digit array. Starting at those 5 digits, Aitken repeated 
the remainder of digits to the end of pi and came back to ?he 
beginning again. I know that it would have taken us much longer 
So ^IhlTn ^ ^°"P"'*'^,J° the same thing starting from scratch. 
i rh^^t ^^-P"""? machine is not likely to displace human beings. 
I think, however, that the area i„ which we may look to CAI for 
ahluf "5f/! that ot educating bright people. Everybody talks 
fnrtlJl Tf 'Children, this is a word that makes me 

furious because although it is true that there are a very large 
number of disadvantaged" children in our society, it is the 
unfortunate fact they happen to be the bright children. Again I will 
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speak aneclotically, but I don't think that any exr^erienced 
educator would dispute the generality of the fact with we. The 
students who come to colleges of engineering in Canada, (nnd from 
experience on faculty at Case Western, I think the same is true 
in the U.S.A.) are about 4 years "retarded*'. Th^ay come up to the 
college on this Continent with the knowledge that the European kids 
have at the age of about 14. The reason for this, in my view at 
least, is that one has to have a grade 12 content which the mayors 
or perhaps the prime minister's son can pass. The mayor and the 
prime minister are often people, of low intellectual though of 
possibly great political craft, and I don't «ee why my children 
should suffer for their stupidity. With a CAI system, one of the 
points that can be made is that the students can go at their own 
rate. I am convinced that this is one of the great potential 
advantages of C.A.I. It has also been pointed out that bright 
students tolerate extremely bad programmiag of the system, and this 
gives a method of system evaluation and of establishing the optimum 
rate of progress through the system. The difficulty with human 
teachers is that they have no real desire to accelerate little 
Johnny because little Johnny is bright. They are much more likely 
now-a-days to say, well, little Johnny you have done your stuff 
quickly, suppose you help little Willie and little Bertha. I don't 
really think thAs is fair to Johnuy. 

Let us talk next, very briefly, about technical developiponts. 
We saw in one of the early presentations at this symposium a 
demonstration of a very complete <;utput console. ^ It has many 
interesting facilities. The touch sensitive tablet developed at 
NRC is one of them. It forms a beautiful method of direct 
communication. Anybody who like« to compare it with the lighc 
pen, will be impressed by the fipeed of reaction of the touch 
sensitive tablet. Two years ©go I spent a few weeks at the 
Lockheed computer centre in Marietta, Georgia, playing with their 
interactive graphics display. Being of a somewhat impatient 
disposition, I became utterly frustrated with using the light pen 
on their CRO and waiting for approximately 15 seconds for any 
response. This device had a computer which, at that time, was 
completely dedicated to servicing my terminal. What would have 
happened if it was servicing 20 others, I don't know. I think that 
the operators would have voted with their feet. The touch 
sensitive tablet may give a method of overcoming some of these 
disadvantages, potentially it seems to have this sort of capability. 
Having said those nice things about the system which was deronstrated 
let me remark that a minimum cost for a basic unit of about $2,000 
and a cost for a fairly sophisticated unit of $10,000 is far too high 
even for universiti/is, let alone for schools. I can't really see 
the Moose Jaw School Board in Saskatchewan ordering 200 of these sets. 



You can do a simple sum which shows that this corresponds in cost 
to the annual operating budget of a fairly large college of 
engineering. I am not going to say which is the better use of the 
money. There is another disadvantage to C.A.I. , which has not been 
mentioned anywhere as far as I am aware: If we have large numbers 
of remote acces stations, we are going to require large numbers of 
people to keep them in operatior . These people do not exist at the 
moment. Possibly the redunlancy of engineers in Canada, and I 
guess in the United States, and the upsurge of the training of 
technicians at the TI's will do something to ameliorate the 
position. But whether or not there be enough people to service the 
10 equipment in the forseeable future seems to me doubtful. Certainly 
if devices which in any sense resemble teletypes are used, I would 
have thought this was very improbable. 

The next point I mention is that of acceptability. Dr. 
Hartley has told us that teachers are very progressive and eager to 
accept new ideas, but on the other hand Mr. Hut ton spent a large 
amount of his time pointing out that teachers are the roost reactionary 
people. He was being anecdotal when he remarked that, since his 
own school days, the children had gone from using a slate pencil 
to using first of all the. quill pen. This presumably was in the 
Montreal region. He then said that, when the steel nib came in 
there was great difficulty in g-tting teachers to accept it. They 
resisted this technical innovation, and their argument was that 
you can always go into the backyard and pluck a feather from a 
chicken and thereby make a quill pen but you can't always get a 
steel nib I One rather wonders to what extent teachers are going 
to accept CAI when some of the novelty and some of the idea that 
it may s*ave them work is worn off. 

The next area for conment is the psychological basis 
of teaching. We have heard a lot about educational psychologists 
and I am sorry to say the impression I got from the papers where 
they were mentioned was that they were umpopular and that nobody 
thought too much of them. This is a great pity because, if we 
don't understand the psychological nature of the process of 
learning, we are unlikely to do much about having computers improve 
this. I would maintain that one of the valid uses of CAI is to 
collect statistics which show the way in which various classes of 
stui^eats go through the learning process. Perhaps even more 
important we might analyse the group of brigh: young people who 
don t too much mind the disorganization of the material pr?!sented 
to them, and use their responses to find better ways of teaching. 
These are the ways which really active minds devise. 

The next area for a very brief comment is that of groups 
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versus single individuals. Now one of the advantages that I have 
always conceived for CAI is that it allows individuals to go at 
their own rate, I said something about the implications of this 
for the gifted a few minutes ago. Of course, the same thing applies 
to the not so gifted with the additional advantage that the not so 
gxfted are often diffident in participation in open class because 
they don t want (a) to be thought to be stupid and (b) shown up by 
the teacher and there are teachers who do this, I am sorry to say. 
CAI systems will get over part of this difficulty. The question, 
however, as to whether you use a unit or a group is rather broader. 
At one time I investigated the teaching of engineering students 
on a multiple small group basis. One of the techniques was to 
use extensive video presentation, film and audio tape controlled 
by a punched paper tape produced by a computer overnight. So 
although the class started off at the same level in lecture number 
1, by the time one week of the course had elapsed, everybody 
was doing his own thing at a different rate. The tapes were 
created overnight and used to service the individual groups. This, 
combined some of the advantages of the batch system with some of 
tne advantages of an individual system. To conclude, let me 
identify what I think to be a few areas of concern. One thing 
which is completely obvious is that we need curriculum development. 
I mention this particularly because it is an area in which it 
IS almost impossible to obtain material support. "Curriculum 
development may lead to the writing a book, and so produce a 
personal profit", it can't be supported from national funds. I 
think these are fallacies. If we don't have curriculum development 
we shall not have any progress in CAI. Have we any areas of success? 
I Identify two from the presentations which have been made here. 
The first of them is in using a computer to teach students 
programming languages. This is outstandingly successful, practically 
all university level students are exposed to a situation in which 
the computer teaches them to program. APL is an obvious example 
oa one of the languages which is used. Basic is another one, 
Fortran yet a third. I lew programming languages, whether 
they are CAI languages or number crunching languages, as being 
meritorious in proportion to the extent to which the student 
doesn t need teaching. I like Basic for the reason that, after 
the first batch of our students was exposed to basic, we were able 
to discontinue all formal instruction. It is such a simple 
language that students learn by looking over the shoulder of 
one of their colleagues who is running a program on the terminal. 
That IS the sort of language that we want, not the sort of language 
where the rules really foul you up. A second area of success 
IS in the use of coi'.puters in simulation. This again is something 
which we have seen in a number of the papers presented at this 
meeting: the simulation of games of business are quite old they 
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formed one of the earliest non-numerical applications of computing 
machines. A more modem simulation is to use computing machines 
to provide, simulated experiments for students. We are using this 
m Saskatchewan in the electrical power systems laboratory vhere 
we have a simulation for the provincial power network. I'his 
gives the students the advantage of being able to make stupid 
mistakes on a large system which, if committed on the real system 
might lead to a power outage over half of the province of Saskatchewan. 
In view of the interconnections which were involved these days. 
It might even put out the lights in Boston and perhaps, as we 
saw on another occasion, increase the birth rate I 

What else does Canada need? For one thing we need £. 
standard language. Despite the remarks we heard earlier on the 
undesireability of identifying one part of the system, Canada 
IS in a state of being an undeveloped country in this area. If 
we let Canada become a developed country, then it's too late. 
So why not do some thinking now? To whitewash ourselves, so' 
that MIT doesn't get a false view of Canada in this respect, let 
me just remark that one of the subjects of agreement at the 
Associate Committee meeting on Tuesday was that, in developing 
a Canadian standard language, we must make use of all of the 
facilities which we have got in current languages. We should 
select their best features and merely add those special lectures 
which we need. We don't want to write something from scratch 
Finally do we need CAI? I am going to suggest to you that by 
far the most. efficient medium of instruction is the book. Perhaps 
If we taught students to read at an early age, there mightn't 
be a need for CAI except for remedial treatment. 
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